DataLad

If we are being honest, hosting DataLad datasets is not the most straightforward thing in the world. Sure, through the power of git-annex, and with the help of a range of DataLad extension packages they can be put pretty much anywhere. But the fact that it is possible does not imply simplicity. There used to be a time when GitLab supported git-annex repositories directly. But with the arrival of Git LFS it got removed. And Git LFS is really no match for git-annex data logistics, so none of the big hosting solutions offer any help here. ...

Managing my music collection was the very first thing I tried with git-annex. That was more than 13 years ago, and till today I continue to use the very same git-annex repository for this purpose. Screenshot of the first commit’s git log of my oldest git-annex repository that is still in active use today. ...

Why would one start a blog in 2024? Isn’t that about 10 years too late? Well, yeah… There is more than one way to keep in touch with the development of the community and the ecosystem of interoperable tools for distributed data management that the DataLad software is a part of. Joey’s git-annex dev blog has been around for a decade at this point. The DataLad handbook was first released five years ago. It is not only an introduction to DataLad, but contains more than a few contributed examples of using git-annex, DataLad and other tools in unison to solve data challenges, mostly focused on research. We posted bits on social media since the beginning. First on the platform that is no longer, and more recently on Mastodon. And this year, we finally had a proper community meet-up at Distribits in Düsseldorf. ...