The UK Department for Business and Trade ran a trial of Microsoft Copilot for Office 365 from October 2024 to March 2025. The Department finally released its findings last month. [DBT, PDF]

The main uses were “transcribing or summarising a meeting”, “writing an email”, and “summarising written communications”.

The bot didn’t do so well on anything more complicated. Users could churn out PowerPoint slides faster, but worse. Excel data analysis was slower, and worse.

And Copilot hallucinated all the way through the study.

  • Brave Little Hitachi Wand@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    ·
    2 days ago

    A chance for Starmer to pretend the last year has all been the fault of LLMs fucking up his meeting notes and take an about-face on Israel, immigration, and AI investment.

    …Please?

  • sunzu2@thebrainbin.org
    link
    fedilink
    arrow-up
    5
    ·
    2 days ago

    Mark my word… Taxpayers will be paying for all of this malinvestment because I do not think VCs and corporate are getting their money back any otherway.