Workflow Automation

Training a model can be a time-consuming process, often taking hours or days, and you may not always be at your computer when it completes. Wouldn’t it be nice to get an email notification once your code has finished executing?

Knock Knock is a lightweight library that sends notifications to your email, Slack, Microsoft Teams, text messages, Discord, and others by simply adding a single decorator to your main function call.

Link to Knock Knock.
Favorite

Kestra is an ideal choice for an open-source orchestrator if you’re looking for the following features:

Language-agnostic workflows.

Seamless integration with your existing tool stack.

An embedded code editor that permits writing code directly from the UI.

Comprehensive dashboard for monitoring workflows.

Link to Kestra.
Favorite

Timely detection and notification of data anomalies are crucial for stakeholders to address potential issues promptly. 

Kestra, an open-source orchestrator, simplifies this process by enabling you to create a workflow using a YAML file.

In the given example, a DuckDB query is used to identify anomalies, and if any are detected, an email with the anomalous rows in a CSV file is sent to relevant parties.

Link to Kestra.
Favorite

Markdown files are more lightweight than PDFs, integrate seamlessly with version control systems like Git, and are easier to edit.

To convert PDFs to markdowns, use Marker, which provides the following features:

Support for a range of PDF documents (optimized for books and scientific papers)

Removal of headers/footers/other artifacts

Conversion of most equations into LaTeX

Formatting of code blocks and tables

Link to Marker.
Favorite