Introducing the sweet sweet labeling suite

You shall now pass!!!

Ok, I get it. A bit cheesy but what can you do?

Over the winter we didn’t break the news to you but by now you probably heard about it:

Today we release not only refinery with a complete overhaul of its previous labeling experience but also extended our online platform with two Major tools. Gates and Workflow. But enough about that. Let’s take a look at the changes in refinery.

Labeling — sweet?

Well, “suite” actually, however, who cares about names anyway? It’s the functionality that counts.

Refinery is meant to be designed for engineers first. We’ve heard that you wanted to gain further control over the annotation process, and that’s why we went back to the drawing board for the labeling suite with one goal: to give you better labeling for quality assurance and automation.

Now it’s here and with it, you can get a quick overview of all the sources affecting your record. This includes manual as well as weak supervision labels just like before. But you can also opt-in to display your heuristics and model callbacks right in the main section.

Not enough? Alright. We also included the option to add different labels to the same section of the record (span labels) as well as chose your labels from all tasks related to the attribute.

Still not enough? No worries. We know everyone ticks a little bit differently so you can customize quite a lot of the functionality of the new labeling suite to your specific preferences.

Please keep in mind that these settings are stored in the local storage of the browser so switching the computer (or browser) will revert them to default.

If you want to know more about labeling in refinery don’t hesitate to look into our docs.

Color me impressed

Ok, maybe not a major change but did you see the new color of refinery? As we extended our platform we also rebuild our primary color for the application. Don’t worry right is still “green” and wrong is still “red”. Your label colors also didn’t change since you are the one who chose them. But the navigation bar as well as the favicon now sport a vibrant Purple. The previous green is reserved for the whole platform so you will still find it in some places.

Routing change

As we extend our platform we had to make some changes to the routing. This will affect your bookmarks so be aware. The previous base route was <domain>/app/projects.

This has now changed to <domain>/refinery/projects.

Everything else will still be the same so simply replacing “app” with “refinery” should solve bookmark issues.

Gates & Workflow

As mentioned above today we not only launch the new version of refinery but also two more tools for the refinery platform (not part of the os solution).

gates: the gateway to your refinery projects. This means with gates you can now create a micro api for any refinery project and send similar data to calculate everything from additional attributes to heuristics and weak supervision results blazing fast.

workflow: the best way to orchestrate your … workflows. Let’s imagine you have a Gmail inbox for your support requests. This can be used to create a refinery project label everything and create a model with it. Now the kicker… You can create a workflow that labels the email or better yet drafts custom responses with the help of gpt3. And this is just one of the many use cases.

To be honest these few lines barely scratch the surface of what you can do with the whole platform. If you’re interested don’t hesitate to reach out or grab a coffee and enjoy our intro video.

Minor Changes

  • Tokenization of newly added attributes now only runs for the specific attribute
  • Bricks integrator extensions for Active learners, dependencies & min Version - issue #205
  • Unknown datatypes are now converted to string on upload - issue #223
  • Added a failsafe for uncertain label uploads - issue #226
  • Lookup list python variables should now work with all names - issue #221
  • The scrolling intersection detection changed for attribute calculation & heuristics - issue #209
  • Rework of multiple components for easier future development - issue #196 & issue #193 & issue #192
  • Crowd heuristic progression changed to start on link generation not slice assignment - issue #227
  • Some naming/display changes

Bugfixes

  • No more label duplication on certain upload cases - issue #225
  • Validation of manual labels is now triggered after a manual upload file - issue #224
  • Looking for empty attributes via EQUAL ‘’ now works - issue #219