LoRA 101 Training Creativity

Training Creativity — How AI Learns to See, Imagine, and Create

By Ilya Mezerovsky

Introduction: Who Am I?

  • Joined monday 3.5 years ago.
  • AI Creative and Productivity Advisor to the CEO.
  • Worked on a variety of projects and product in the company.
  • Been using, exploring and developing AI based tools before they were cool.

First AI image today

What Is a LoRA?

LoRA (Low-Rank Adaptation) in simple terms:
  • A smaller, specialized “add-on” for large models

What Is a LoRA?

SUBJECT

STYLE

Same object diffirent conditions.

Same concept diffirent applications.

Building a Custom LoRA
  1. Define the Topic (e.g., Llama and illustrations).
  2. Gather & Prepare Data (labeling, etc.).
  3. Train the LoRA.
  4. Test & Iterate.

Building a Custom LoRA

  1. Define the Topic (e.g., Mansion Rooms)

Building a LoRA

2. Gather & Prepare Data (labeling, etc.)

 

Building a LoRA

2. Gather & Prepare Data (labeling, etc.)

 

  • Virtual Event Space
  • 3D Environment
  • Monday.com
  • Gamified Experience
  • Digital Conference Room
  • Interactive Screens
  • Neon Lighting
  • Futuristic Design
  • Tech Event
  • Immersive Branding
  • Green & Blue Aesthetic
  • Holographic Elements
  • Networking Space
  • Exhibition Booth
  • Virtual Presentation
  • Modern UI/UX
  • Corporate Metaverse
  • Tech Showcase

 

Best Practices for LORA datasets

  1. Set a trigger.
  2. 3-300 images – for style loras try varying objects and scenarios.
  3. Keep the images in the same aspect ratio.
  4. Generate synthetic data when needed.

Building a LoRA

3. Train the LoRA

Building a LoRA

4. Test results

Building a Custom LoRA

4. Test results

Building a Custom LoRA

4. Test results

Building a Custom LoRA

4. Test results

Building a Custom LoRA

4. Test results

Building a Custom LoRA

4. Test results

Building a Custom LoRA

4. Test results

Thank You!

Q&A / Discussion

Thank You!

Q&A / Discussion

Resources and

Use-cases

Text Gen AI

Use Cases:

  • Content Generation: Articles, blog posts, marketing copy, product descriptions.

  • Conversational AI: Chatbots, virtual assistants, automated customer support.

  • Code Generation: Autocompletion, code refactoring, documentation generation.

  • Summarization: News aggregation, meeting minutes, legal document summarization.

  • Translation & Localization: Language translation, dialect adaptation, cultural customization.

  • Creative Writing: Storytelling, poetry, scriptwriting.

  • Text-based Game/NPC Dialogue: Dynamic character interactions, procedural quest generation.

  • Data Analysis & Insights: Report automation, financial analysis, trend prediction.

Text Gen AI

  • ChatGPT (OpenAI) – A conversational assistant
  • LLaMA (Meta) – An open-source language model
  • Claude (Anthropic) – A writing & project management assistant
  • Custom Finetunes – Tailored open-source models trained on specific data

Image Gen AI

Use Cases:

  • Image Generation: Concept art, marketing visuals, social media graphics.
  • Inpainting & Editing: Object removal, image enhancement, style transfer.
  • Super-resolution: Improving image quality (e.g., upscaling old photos).
  • AI-driven Design: Logos, UI/UX elements, 3D textures.
  • Product Visualization: E-commerce previews, fashion and interior design mockups.
  • Medical Imaging Analysis: AI-assisted X-ray, MRI, and CT scan analysis.
  • Security & Surveillance: Face recognition, object detection.

Image Gen AI

  • Midjourney – Text-to-image creation
  • Stable Diffusion – Open-source text-to-image
  • Flux – Photo-realistic image generation

Video Gen AI

Use Cases:

  • Video Generation: AI-generated films, animated explainer videos, deepfake synthesis.
  • Video Editing & Enhancement: Auto-colorization, frame interpolation, stabilization.
  • Virtual Production: AI-assisted CGI, background replacement, motion capture.
  • Personalized Content: AI-driven dynamic ads, customized video messages.
  • Automated Video Summarization: Highlight reels, scene detection for content creators.
  • Security & Surveillance: AI-powered threat detection, anomaly tracking.
  • Synthetic Training Data: AI-generated simulations for machine learning training.

Video Gen AI

  • Runway – AI-powered video creation & editing
  • AnimateDiff – Text-to-animation approach
  • Hunyuan - Opensource video generation

3D Gen AI

Use Cases:

  • 3D Asset Generation: Game development, architecture, digital twin simulations.
  • Procedural Environment Creation: AI-assisted world-building in games & VR.
  • 3D Character Creation: AI-generated humanoids, creatures, avatars.
  • Motion Capture & Animation: AI-driven pose estimation, facial animation.
  • Manufacturing & Prototyping: AI-generated CAD models, 3D printing optimization.
  • Medical Applications: AI-assisted prosthetic design, anatomical modeling.
  • Augmented Reality (AR) & Virtual Reality (VR): AI-powered object recognition and placement.

3D Gen AI

  • Trellis – AI-driven 3D modeling
  • Meshy – Automated 3D mesh generation & optimization
  • HunYuan - Open sourced 3D models 

Audio Gen AI

Use Cases:

  • Speech Synthesis & Voice Cloning: AI-generated voiceovers, personalized digital assistants.
  • Music Generation & Enhancement: AI-composed music, auto-mixing, and mastering.
  • Sound Design & Foley: AI-generated sound effects for movies and games.
  • Noise Reduction & Enhancement: Podcast cleanup, audio restoration.
  • Speech Recognition & Transcription: AI-driven subtitles, accessibility tools.
  • Emotion & Sentiment Analysis: AI-powered call center analytics, audience sentiment tracking.

Audio Gen AI