Data data everywhere…
Let our shiny new columnist Dr Matthew Partridge take you by the hand and lead you through the niggles of life in the lab
After almost a decade in science, I am beginningย to realise that I am incurably cursedย with data envy.
Now this isn't the kind of data envy you might expect - I have plentyย of data, gigabytes of it in fact. If anything, a little less data might be nice โ especially from those experiments where I forgot to turn on one of the bits of kit and had to restart it. Nor do I want my data to be 'good' data, as I'm pretty happy even when things don't work. No, I don't have any normal sensible kind of data envy, I have 'organised' data envy.
Almost any research project these days generates huge volumes of data โ some of it useful, some will be forever consigned to the back of a hard drive. But all of it will be hoarded away in the hope that one day some tiny nugget of it will shine though as a great discovery. Even if you don't feel this squirrel-like urge, then I would expect your employer certainly does โ no company or university wants to accidentally throw away vital data.
These days that hoarded data exists in two places โ lab-books and electronic data sets. Lab-book quality varies GREATLY between employers and employees. I was taught great lab-book housekeepingย at my first job, which would have been a real boon if I had ever actually followed any of the advice...
So for me and many others, the electronic copy of the data is the go-to source for information on which experimentsย you ran in the past. Unfortunatelyย for future me, past me is absolutely terrible at data organisation.
It's not that I don't try to be nice and organised. I've lost track of how many times I've started a new research project thinking "this time will be different, this time I'll keep an organised data system". I get positively excited about how organised my data will be โ I have reached the point now where I'll even plan out file systems in advance so that there is no way they can fail to keep me organised and on track.ย However, no matter the planning and care that goes into these systems it always falls apart the same way.