How can you transition from photo-type or exploratory research software to production code? Can you? I've been discussing this with my guest Duncan McGregor. In the first part of our discussion we touch on how you can effectively analyse large data sets that are distributed over different locations with tools like Dask. Links:https://www.youtube.com/@PairingWithDuncan Duncan's YouTube channelhttps://www.oneeyedmen.com Duncan's websitehttps://github.com/dmcg and his GitHubhttps://www.dask.org Daskhttps://github.com/aws-solutions-library-samples/distributed-compute-on-aws-with-cross-regional-dask cross regional programming with Daskhttps://aws.amazon.com/blogs/big-data/build-efficient-cross-regional-i-o-intensive-workloads-with-dask-on-aws/https://blog.dask.org/2022/07/19/dask-multi-cloudhttps://zarr.readthedocs.io/en/stable/ Zarr formathttps://en.wikipedia.org/wiki/NetCDF NetCDFhttps://www.ecmwf.int European Centre for Medium Range Weather Forecastshttps://github.com/ecmwfhttps://www.eumetsat.inthttps://pangeo.iohttps://testbook.readthedocs.io/en/latest/ Unit testing with Jupyterhttps://github.com/nteract/testbookConferences/Events:https://dhrse2025.er.kcl.ac.uk King's College London: summer school for digital humanities. 30 June - 4 July, Londonhttps://www.software.ac.uk/workshop/collaborations-workshop-2025-cw25 The annual Collaborations Workshop of the Software Sustainability Institute UK, 13-15 May, University of Sterling, Scotlandhttps://www.helmholtz-hirse.de/events/2025_06_13-rsehpcatisc.html The RSE workshop (13 June) at the ISC conference in Hamburg, Germany https://nordic-rse.org Nordic RSE Conference, Gothenburg, Sweden 20-21 MayGet in touchThank you for listening! Merci de votre écoute! Vielen Dank für´s Zuhören! Contact Details/ Coordonnées / Kontakt: Email mailto:[email protected] UK RSE Slack (ukrse.slack.com): @code4thought or @piddie Bluesky: https://bsky.app/profile/code4thought.bsky.social LinkedIn: https://www.linkedin.com/in/pweschmidt/ (personal Profile)LinkedIn: https://www.linkedin.com/company/codeforthought/ (Code for Thought Profile) This podcast is licensed under the Creative Commons Licence: https://creativecommons.org/licenses/by-sa/4.0/

Ver todos los episodios