Version 1.6.0 of refinery introduces changes to the data browser to provide enhanced filtering capabilities for attributes. It is now also possible to rename labels in the whole project and change the source code in which labels are used with one click. The refinery demo application was also overhauled in order to achieve higher accessibility and cover multiple different roles. Various bugs have been addressed in this version of refinery as well.
For this new version of refinery, we set ourselves the goal to improve some of the existing parts of the application and create connections to existing labeling tools. Outside of the application, we worked on reducing the overall size of refinery and all the docker images combined are now just 5.2 GB in size. In the application, you can now select new data types for calculated attributes to better reflect how that data should be treated. The global comment system we introduced in v1.4.0 now looks a lot better and slides in smoothly from the side of the screen. If you want to export your records, you can now precisely select the format, attributes, labeling tasks, and much more.
The new version 1.4.0 offers some new features as well as some minor changes under the hood. One of the key features is the creation of comments directly inside the app. The new version also updates the labeling function feature, enabling you to now test your functions on 10 random samples to save time and computation.
We added the functionality to calculate new attributes with python code, which you can use to engineer new features for your data within refinery. We also added a new chart, which lets you inspect the Weak Supervision confidence distribution at a single glance. If you signed up for our managed version, then you can enjoy a freshly added role management system that lets you decide who gets to label what. For details on all of this, take a look at the full changelog - you won't regret it!
In this update we address one of the major pain points when dealing with such an array of different services: version management. Additionally we enriched our SDK, which now contains more adapters to a few of your favourite open-source ML frameworks.
Refinery v1.1.1 fixes various bugs for the demo playground.
Usually, we give you a bunch of smaller improvements to further enhance your experience using kern. We still have some, but this time around we spared neither time nor headaches to give you some exciting new possibilities. This includes the brand new type of Information Source "Zero-Shot", as well as some further Data Browser capabilities like an embedding-powered similarity search (thanks Qdrant!).
Now, who got the Friends reference? That's right. It's all about some insights into our peers. With our previously introduced multi-user labeling workflow, it's now time to get some insights in the form of a brand new graph—the inter-annotator agreement. And as if this wasn't enough, we overhauled our embedding creation and active learning module.