Grab your coffee. Here are this week’s highlights.

---

📅 Today’s Picks

MLflow: Built-in Scorers for LLM Evaluation Without Custom Logic

Problem

Ensuring consistent LLM quality means checking correctness, relevance, and guideline adherence.

But writing custom evaluation logic for each criterion is tedious.

Solution

MLflow provides pre-built scorers for common evaluation patterns with simple decorator syntax for custom metrics.

Key capabilities:

• Built-in scorers for correctness and guideline compliance
• Simple @mlflow.scorer decorator for custom metrics
• Standardized evaluation patterns across projects
• Visual summary of all assessment results in MLflow UI

---

🔄 Worth Revisiting

Swap AI Prompts Instantly with MLflow Prompt Registry

Problem

Finding the right prompt often takes experimentation: tweaking wording, adjusting tone, testing different instructions.

But with prompts hardcoded in your codebase, each test requires a code change and redeployment.

Solution

MLflow Prompt Registry solves this with aliases. Your code references an alias like “production” instead of a version number, so you can swap versions without changing it.

Here’s how it works:

• Every prompt edit creates a new immutable version with a commit message
• Register prompts once, then assign aliases to specific versions
• Deploy to different environments by creating aliases like “staging” and “production”
• Track full version history with metadata and tags for each prompt

---

📢 ANNOUNCEMENTS

Introducing CodeCut Premium

I put a lot of effort into making every CodeCut blog clear, practical, and example-driven. Still, there’s a gap between reading code and actually writing it yourself.

CodeCut Premium bridges that gap with interactive courses that let you:

• Execute code directly in your browser
• Skip installation and environment setup
• Test your understanding with built-in quizzes
• Learn faster than sitting through long video courses

I plan to add new courses regularly, with a focus on quality and depth. The catalog is still growing, and Founding Members get early access plus exclusive perks as it expands.

Founding Members receive lifetime $12/month pricing, full access to all courses, and early influence on future content.

Founding pricing ends March 31, 2026.

---

☕️ Weekly Finds

zipline [Finance] – Pythonic algorithmic trading library with event-driven backtesting for building and testing trading strategies

outlines [LLM] – Structured text generation library that constrains LLM outputs to follow specific schemas, formats, and data types

responses [Testing] – Utility library for mocking out the Python Requests library in tests with simple decorators and context managers

Looking for a specific tool? Explore 70+ Python tools →

---

📚 Latest Deep Dives

5 Python Tools for Structured LLM Outputs: A Practical Comparison – Compare 5 Python tools for structured LLM outputs. Learn when to use Instructor, PydanticAI, LangChain, Outlines, or Guidance for JSON extraction.

---