Workflow Automation

pytube is a lightweight Python library that enables you to download YouTube videos and playlists in specific formats and resolutions.

If you want to schedule Python functions using expressive and customized scheduling statements, use Rocketry.

Unlike other tools, Rocketry doesn’t make any assumptions about your project structure, making it perfect for fast and efficient automation projects.

Documentation helps other developers understand how to use your code effectively. However, manually creating documentation can be time-consuming.

With pdoc3, you can automatically generate API documentation based on the docstrings of your Python files and objects.

pix2tex is a Python library that allows you to convert images of equations into LaTeX code.

This allows you to incorporate an equation from a document into another document without recreating the equation from scratch.

If you want to collaborate on Markdown notes in real time, use HedgeDoc.

In the video above, the red bar indicates editor 1 and the yellow bar indicates editor 2. Both editors can instantly view each other’s changes as they happen.

Popular orchestration libraries such as Airflow require altering Python code to use their features, which makes the codebase more complex and harder to maintain. 

To separate data science code from orchestration logic, use Kestra.

With this approach, data scientists can prioritize model processing and training, while data engineers can focus on building workflows.

PDF text is designed for beautiful on-screen display rather than optimized structured data extraction, making text extraction from PDFs challenging. 

Besides simple text extraction, pypdf also knows about fonts, encodings, and typical character distance, which enhances the accuracy of text extraction from PDFs.

Testing each change with cloud resources can become costly and time-consuming. With LocalStack, you can test your AWS cloud apps locally.

This significantly reduces cloud resource consumption and provides immediate feedback on your local changes.