Fine-Tune an LLM for Code Generation

you own this product
prerequisites
Intermediate Python • Beginner Hugging Face • Familiarity with software development workflows
skills learned
Fine-tuning an LLM for code generation • Converting natural language specifications into functional code snippets • Improving developer workflows with AI-assisted coding
Tobias Zwingmann
Included with a Manning Online subscription

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases
  • renews monthly, pause or cancel renewal anytime

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

Look inside
Like many businesses, there’s never enough hours in the day for X Education’s development team. That’s why in this liveProject, you’ll be helping them be more productive than ever by building them a specialized HTML code generation AI! Your

AI will be based on a pretrained Llama 3.2 model and be entirely based on-site with no reliance on external services. You’ll set up your Colab environment with Unsloth and preprocess a commit-style dataset into instruction–input–output triples. Next, benchmark the base model’s code generation skills, then fine-tune it with LoRA. Finally, you’ll evaluate the fine-tuned model against the baseline, comparing consistency, correctness, and output quality.

This project is designed for learning purposes and is not a complete, production-ready application or solution.

project author

Tobias Zwingmann
Tobias Zwingmann is a leading AI expert and advisor. As Managing Partner at Germany-based RAPYD.AI, he helps companies adopt AI and machine learning faster while achieving meaningful business impact. Leveraging his background as a data scientist and over 15 years of experience at the intersection of business and technology, Tobias has led AI initiatives across a wide range of industries, from early-stage prototyping to full-scale deployment.

prerequisites

This liveProject series is for intermediate Python programmers who understand both data processing and machine learning basics, and are keen to adapt these skills to creating and tuning Large Language Models.


TOOLS
  • Intermediate Python
  • Basics of Google Colab
  • Basics of Pandas
  • Basics of PyTorch
  • Basics of Huggingface
TECHNIQUES
  • Basics of data preprocessing
  • Basics of machine learning
  • Basics of Text Data Handling

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from fellow participants and even more help with paid sessions with our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.
choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • renews monthly, pause or cancel renewal anytime
  • renews annually, pause or cancel renewal anytime
  • Fine-Tune an LLM for Code Generation project for free

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • renews monthly, pause or cancel renewal anytime
  • renews annually, pause or cancel renewal anytime
  • Fine-Tune an LLM for Code Generation project for free