A fireside chat with Boost and the National Library of New Zealand, as we tell a story that starts with humble metadata harvesting, and leads into a redevelopment of our Supplejack harvesting tool which has opened up a few new horizons that we would like to share.
Built by Library and Boost staff in collaboration over the past 11 years, the open-source Supplejack software has served us well in playing a key role in enabling the DigitalNZ web service and API. To support the ever-larger collection harvests that our teams have been encountering, we decided to embark on a re-write of the Supplejack application, and what we’ve ended up with is a tool that might present some opportunities for people in the AI/LLM and data sovereignty intersections.