• macrocephalic@lemmy.world
    link
    fedilink
    English
    arrow-up
    38
    arrow-down
    2
    ·
    1 year ago

    Now if only it would stop dropping leading zeros unless you ask it, and we got rid of the MM/DD/yyyy date format entirely.

  • Artyom@lemm.ee
    link
    fedilink
    English
    arrow-up
    37
    arrow-down
    3
    ·
    1 year ago

    The idea that any scientist is doing data analysis in Excel is honestly terrifying on every level.

    • griffinsklow@feddit.de
      link
      fedilink
      English
      arrow-up
      21
      arrow-down
      1
      ·
      1 year ago

      I remember when a biologist asked us for help - Excel crashed on processing his 700MB tables. Took some time and Chatgpt to convince him to do the analysis in R. It worked out in the end and he is now recommending this solution to his colleagues, which is nice.

    • Blackmist@feddit.uk
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 year ago

      Flashback to the time the UK government lost 16,000 positive COVID patients because Excel has a 1 million row limit.

      If only there were better ways of storing large amounts of records with a fixed structure. Maybe the future will provide such technology…

    • Evotech@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      7
      ·
      1 year ago

      Excel is excellent at data analysis… Python integrations and everything

        • filcuk@lemmy.zip
          link
          fedilink
          English
          arrow-up
          12
          arrow-down
          1
          ·
          edit-2
          1 year ago

          Because every scientist is also a programmer?
          Especially if they struggle to use Excel properly, no chance.

          • cabron_offsets@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            I’d be embarrassed to call myself a scientist if I didn’t know how to at least script basic shit and effortlessly reproduce data analyses. The bar for entry into every single stage of academic science is too fucking low. 95% of this literature is irreproducible shit, in part because fuckwits don’t know how to code. Scientists don’t need to be software engineers, but yes, they need to be able to program. It wasn’t this way 20 years ago, but it most certainly is nowadays.

      • cabron_offsets@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Excel sucks open ass. At storing data, at displaying data, at analyzing data. Scientists, of all people, should understand how to use an RDBMS and a data processing framework like R.

    • Wooshock@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      10
      ·
      1 year ago

      What the hell else is there? Good luck getting universities using OpenOffice

      • asdfasdfasdf@lemmy.world
        link
        fedilink
        English
        arrow-up
        17
        arrow-down
        5
        ·
        edit-2
        1 year ago

        Scientists should be using programming languages like R or Python. They are both extremely popular in this field, much more than Excel.

          • Hawk@lemmynsfw.com
            link
            fedilink
            English
            arrow-up
            7
            arrow-down
            5
            ·
            1 year ago

            Except every scientist and analyst. Stats, data sci and ML is done in R and Python, be it astro, health data or genomics.

            If someone has been taught stats in spreadsheet software, they have have been taught wrong, period.

            Also, programming is a very strong term. we’re talking about stats in a scripting language, not software development in CPP.

          • isles@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            3
            ·
            1 year ago

            Research projects almost exclusively have more than one person working on them.

              • atzanteol@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                1 year ago

                Programming in R or Python isn’t a lot harder than learning how to get Excel to do what you want. I’d wager it’s easier since you don’t have to fight your tools.

                Excel has its place for simple quick calculations. But at some point it’s simply the wrong tool.

  • MonkderZweite@feddit.ch
    link
    fedilink
    English
    arrow-up
    28
    arrow-down
    1
    ·
    1 year ago

    20 years after the problem was first reported.

    Meaning there’s still hope for XDG support in Firefox?

  • MelodiousFunk@kbin.social
    link
    fedilink
    arrow-up
    12
    ·
    1 year ago

    Me before reading the article: It’s got to be dates. Excel thinks everything is a date.

    Me after reading the article: Even the workaround is halfhearted. Jeebus.

    • TwinHaelix@reddthat.com
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 year ago

      Microsoft’s blog adds caveats, such as that Excel avoids the conversion by saving the data as text, which means the data may not work for calculations later. There’s also a known issue where you can’t disable the conversions when running macros.

  • CatLikeLemming@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    3
    ·
    1 year ago

    This isn’t a fix. Excel wasn’t meant for this. While I do understand it’s convenient as a database, unless you’re doing something unimportant and small you just really should use something proper. And even now that this “problem” is gone, I am certain there are still more things that cause trouble. You can not satisfy everyone and Excel was just… not made for gene info storage.

    Even if you don’t want to use stuff that isn’t Microsoft Office, that comes with Microsoft Access, which is a proper database management system. It’s literally in the same software package, so why do people refuse to use it?

    • zalgotext@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      28
      ·
      1 year ago

      Why would you need a full blown (shitty) relational database management system to store gene info? Excel should be just fine for storing data in arbitrary tables. It shouldn’t make assumptions about your data by default, and changing values that look like they’re in a specific format should be opt-in, not default behavior.

      • Hawk@lemmynsfw.com
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        Sqlite and duckdb are great, I don’t know about shitty.

        You don’t get the visual feedback but the query language, reliability and python interface are all top notch.

      • CatLikeLemming@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        1 year ago

        That is not what it was made for. It was made to do shenanigans with values like doing math on them and plotting graphs. If you merely want data storage, use a table. I agree, a database is overkill for most things, but that doesn’t change the fact that Excel is the wrong tool for the job. Maybe if they added a table mode where it’s basically just a frontend for a csv it’d work, but right now I’d still say it’s better to use a scalpel than a hammer, even if scissors do the trick just fine.

    • Echo Dot@feddit.uk
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      3
      ·
      1 year ago

      I’m so sick of people using Excel for things it’s not supposed to be used for.

      As a general rule if you’re not actually making use of the formula tool, you probably don’t need to be using Excel.

      • CatLikeLemming@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        I’ve never used Access personally, so I don’t know if it’s any good or not, I’m just frustrated by people using spreadsheets for data storage.

        • Evotech@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          1 year ago

          It’s been years since I used it tbh. But “access bad” is a meme for a reason

  • detalferous@lemm.ee
    link
    fedilink
    English
    arrow-up
    8
    ·
    1 year ago

    From the article:

    The problem of Excel software (Microsoft Corp., Redmond, WA, USA) inadvertently converting gene symbols to dates and floating-point numbers was originally described in 2004 [1]. For example, gene symbols such as SEPT2 (Septin 2) and MARCH1 [Membrane-Associated Ring Finger (C3HC4) 1, E3 Ubiquitin Protein Ligase] are converted by default to ‘2-Sep’ and ‘1-Mar’, respectively. Furthermore, RIKEN identifiers were described to be automatically converted to floating point numbers (i.e. from accession ‘2310009E13’ to ‘2.31E+13’). Since that report, we have uncovered further instances where gene symbols were converted to dates in supplementary data of recently published papers (e.g. ‘SEPT2’ converted to ‘2006/09/02’). This suggests that gene name errors continue to be a problem in supplementary files accompanying articles.

  • neuropean@kbin.social
    link
    fedilink
    arrow-up
    6
    ·
    1 year ago

    Thank god! You have no idea how awful this is for scientists. Need to paste some gene names down? Better hope it’s not MARCHF8 or in the Septin gene family, otherwise you have to convert columns to text then import the data. Seems like a simple fix, but many wet lab biologists are technologically challenged.

  • JoBo@feddit.uk
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    It’s no good having this as part of the user options. It should be a sheet characteristic and the default should be “keep cells exactly as entered regardless of data type”.

  • chepox@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    "Microsoft’s blog adds caveats, such as that Excel avoids the conversion by saving the data as text, which means the data may not work for calculations later. There’s also a known issue where you can’t disable the conversions when running macros. "

    This sounds very half assed…

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    This is the best summary I could come up with:


    In 2020, scientists decided just to rework the alphanumeric symbols they used to represent genes rather than try to deal with an Excel feature that was interpreting their names as dates and (un)helpfully reformatting them automatically.

    Yesterday, a member of the Excel team posted that the company is rolling out an update on Windows and macOS to fix that.

    Excel’s automatic conversions are intended to make it easier and faster to input certain types of commonly entered data — numbers and dates, for instance.

    But for scientists using quick shorthand to make things legible, it could ruin published, peer-reviewed data, as a 2016 study found.

    Microsoft detailed the update in a blog post this week, adding a checkbox labeled “Convert continuous letters and numbers to a date.” You can probably guess what that toggles.

    The update builds on the Automatic Data Conversions settings the company added last year, which included the option for Excel to warn you when it’s about to get extra helpful and let you load your file without automatic conversion so you can ensure nothing will be screwed up by it.


    The original article contains 225 words, the summary contains 184 words. Saved 18%. I’m a bot and I’m open source!

    • JackGreenEarth@lemm.ee
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      3
      ·
      1 year ago

      Why are scientists using a paid service such as Excel anyway? Shouldn’t they be using something like Libre Open Office?

      • LogarithmicCamel@feddit.uk
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        You are completely right, and the Open Science movement is catching on. The idea is to give everyone access to the (anonymised) data and use only tools that are freely accessible, even to scientists from developing countries without Microsoft licenses, so that they too can rerun your analyses and verify your results. You shouldn’t be getting downvoted.

        • emergencyfood@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          0
          arrow-down
          1
          ·
          1 year ago

          In science, it is important to have verifiable and replicable results. This means everything you use - from ingredients to software - should be transparent. We can’t examine Excel’s source code, so we don’t know if it is working as it claims to be. Most scientific disciplines are moving towards open source, open access etc., and you can’t use Excel in fields like physics or mathematical biology. But molecular biology is a bit of a holdout.

      • driving_crooner@lemmy.eco.br
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        1 year ago

        In college a professor gave us some homework to be done in excel, and as the nerd that I am, I asked if Livre Office was ok because I use Linux and have no access to Excel. The professor was like, well in that case everyone do the homework on R or python. My classmates were really mad at me for that.

  • Etterra@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    4
    ·
    1 year ago

    Office Libre is free, and modern MS Office UIs looks like dog dookie. OL can also save in Excel format if you want.

    Hey look at that, I found a solution that didn’t require they change their entire process or have to wait for Microsloughed to get their act together.

    • Moneo@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Libre calc is one of the worst UXs I have ever had the displeasure of using. I can’t imagine anyone recommending it is using it as their main work application.

  • Deebster@programming.dev
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    1 year ago

    It’s too late though, scientists already had to rename the genes. Although of course there are other things that can trigger it, not just in science.