Flux.1 prompting and guidance guides

CyberJungle, the Youtube channel of Hamburg-based Senior IT Product Manager Cihan Unur, recently posted a great video on consistent generated characters.

There are lots of great insights in this 20-minute video. Two outstanding takeaways:

First: a prompting guide for Flux.1. At 15:28 he reveals three prompting styles: list, natural language and hybrid.

Second: a guidance guide for Flux.1. At 17:18 he shows Photorealistic and Cinematic images with a wide scope of guidance values. He posits:

“The essence of guidance setting is a compromise or a balance between photo realism and prompt understanding.”

See 18:36 for the Photorealistic results. He prefers a level of two.

See 19:54 for the Cinematic guidance level he prefers: again two.

My take: to me, too often generated images look over-the-top and so ideal, they’re unrealistic. The key seems to be dialing the guidance down to two. Who knew? Now, you do.

New Generated Video pipeline?

A couple of very recent videos point to a potential new Generated Video, or GV, pipeline.

The first is “Create Cinematic Ai Videos with Kling Ai! – Ultra Realistic Results” by Seattle’s Yutao Han, aka Tao Prompts.

The second is “How-To Create Uncensored Images Of Anyone (Free)” by Lisbon’s Igor Pogany, aka The AI Advantage.

Imagine combining both into a new GV pipeline:

  1. Train custom character models
  2. Create key frames utilizing these custom models
  3. Animate clips with these key frames
  4. Upscale these clips
  5. Edit together.

My take: a lot of people will immediately claim this is heresy, and threatens the very foundations of cinema as we’ve come to know it over the last one hundred years. And they would be right. And yet, time marches on. I believe some variation of this is the future of ultra-low budget production. Very soon the quality will surpass the shoddy CGI that many multi-million dollar Hollywood productions have been foisting on us lately.

Compare Image Generators at a glance

Matt Wolfe has just released a wonderful comparison of top image generators tackling four different types of pictures on YouTube.

The four image categories are:

  • Human Realism
  • Landscapes
  • Scenery incorporating Text
  • Surrealistic Images

The platforms are:

  1. Ideogram 2.0
  2. MidJourney 6.1
  3. Mystic
  4. Phoenix
  5. Flux.1 (Grok)
  6. Dall-e 3
  7. SD3
  8. Firefly 3
  9. Meta Emu
  10. Imagen 3
  11. Playground v3

See the Figma board to see all eleven contenders at once.

My take: as a visual learner, I really appreciate this side-by-side comparison. Thank you, Matt!

August 2024 AI Video Pipeline

Love it or hate it, as of August 2024, AI Video still has a long way to go.

In this video, AI Samson lays out the current AI Video Pipeline. Although there are a few fledgling story-building tools in development, full-featured “story mode” is not yet available in AI video generators. The current pipeline is:

  1. Create the first and last frames of your clips
  2. Animate the clips between these frames
  3. Create audio and lip-sync the clips
  4. Upscale the clips
  5. Create music and SFX
  6. Edit everything together offline.

It seems new platforms emerge weekly but AI Samson makes these recommendations:

00:23 AI Art Image Generators
09:19 AI Video Generators
16:28 Voice Generators
18:02 Music Generators
20:44 Lip-Syncing
21:52 Upscaling

Keep an eye open for LTX Studio though.

My take: You know, the current pipeline makes me think of an animation pipeline. It’s eerily similar to the Machinima pipeline I used to create films in the sandbox mode of the video game The Movies over ten years ago:

September 8 deadline for CIFF Pitch Sessions

Folks who follow this blog, know that I love Telefilm‘s Talent to Watch competition. It remains your best chance at funding your first feature film in Canada.

Until they allowed direct submissions from underrepresented folks two years ago, this is normally a two-stage process. Each of approximately 70 industry partners get to forward one (and sometimes two or three) projects to Telefilm and then the Talent to Watch jury selects eighteen or so for funding.

The prize? $250,000. One quarter of a million dollars.

Don’t belong to one of the Industry Partners? No problem!

The Chilliwack Independent Film Festival has got you covered. Launched last year, Pitch Sessions lets you throw your first feature project into the ring; five are selected to then pitch in person at the festival and the winner becomes CIFF’s nominee to Telefilm’s next Talent to Watch competition.

Oh yah, the top five also get free passes and a hotel room for the festival.

The deadline to apply to Pitch Sessions at the 2024 Chilliwack Independent Film Festival is September 8.

My take: If you’ve got a spare $100 and you want to hone your pitch in public, this is a great opportunity. Note that each industry partner sets their own rules but this is the only one I know of that incorporates a live pitch. Just be aware that Telefilm typically doesn’t open the Talent to Watch competition until mid-April.

Deadline approaches for women to apply to BANFF Spark

The application deadline for this year’s BANFF Spark Accelerator for Women in the Business of Media: Producers Edition is rapidly approaching: August 12, 2024.

BANFF Spark provides market access, training, and networking opportunities to help build more Canadian women-owned media businesses.

“Since the program began in 2019, BANFF Spark has already provided opportunities for more than 200 women entrepreneurs. The program is open to all candidates and is designed to empower women of colour, Indigenous women, women with disabilities, 2SLGBTQI+ women, and non-binary individuals.”

All selected participants will receive:

  1. Online workshops (that address the core components of business development).
  2. Networking opportunities with top industry professionals.
  3. A full-access pass to the 2025 Banff World Media Festival (June 8-11, 2025) and its complement of top industry sessions and international marketplace.
  4. A $1500 CAD travel stipend to attend the 2025 Banff World Media Festival
    (on the condition of in-person Festival attendance).

Apply here.

My take: I love that this is focussed on people and not squarely on projects. I don’t have to mansplain this, just apply!

July 2024 Tier List for AI Video

Igor Pogany of The AI Advantage recently released a YouTube video that succinctly summarizes the current state of AI Video.

The tools he reviews are:

His favourites (dated mid-July 2024) are:

Runway GEN-3 Alpha and Luma Dream Machine for their clip outputs, but watch out for LTX Studio because of their overall project approach.

See the full tier list at 12:48 for the tl;dr.

My take: this is a super-valuable video that can get you up-to-date in under 14 minutes. Well worth your time.

ScriptReader.ai offers script analysis for $9.99

Jason Hellerman reports on No Film School that AI Says My Screenplay is Better Than ‘Silence of the Lambs’ and ‘Schindler’s List’.

He begins, “This morning, a really lovely NFS reader reached out to me and wanted my opinion on a program called ScriptReader.AI, which charges $10 for a complete screenplay breakdown.”

He uploads one of his scripts and in two hours gets extensive coverage. It appears the AI’s method is to rate each scene and then average the scores. His script gets a “Recommend.”

However, Jason is not impressed. He concludes:

“Computers cannot think and feel. They have zero sense of nuance. And you cannot take their coverage seriously. No matter how nice it is. AI coverage is worthless!”

My take: the ScriptReader.ai website woefully undersells its capabilities. It certainly looks sketchy. But you can test out three scenes for free.

And then there’s a link in the top right corner of the website labelled “SHALL WE PLAY A GAME?_” I recognized this as a reference to WarGames in which Matthew Broderick unwittingly provokes WWIII.

With some trepidation, I clicked on the link.

This brought me to a page titled “SceneProv_” with two modes, Fun and Training.

I decided to have some fun and generate a scene for a RomCom. The AI, suddenly my writing partner, set the scene and populated it with two characters. My interactions are bolded.

“Genre selected: romance

INT. COFFEE SHOP – DAY

JEN sits at a table with a book, sipping on her latte. She notices AIDEN walk in and their eyes meet.

JEN:
(smiling)
Hey!

AIDEN:
(nervously)
Hi! Can I sit here?

JEN:
(surprised)
Uh, sure!

AIDEN sits across from Jen and they strike up a conversation.

AIDEN:
I noticed you’re reading “Do Androids Dream of Sheep?”.

JEN:
Yup. It’s my favourite book.

Her eyes glitch.

AIDEN:
Do you want to go back to my place?

JEN:
(surprised)
Excuse me?

AIDEN:
(smiling)
Not like that. I have a first edition copy of that book. I’d love to show it to you.

JEN:
(relieved)
Oh, sure. That sounds great.

INT. AIDEN’S PLACE – NIGHT

Aiden and Jen are sitting on the couch, looking at the first edition. Her eyes glitch again.

AIDEN
Jen, why do your eyes “glitch?”

JEN
What do you mean?

AIDEN
Well, every once in a while they kinda spark.
Are you hiding something from me?

Jen looks at Aiden angrily and stands up quickly.

JEN:
(angrily)
No, I’m not hiding anything! It’s just a glitch in my synthetic retinas. I’m an android.

AIDEN:
(surprised)
An android? I had no idea.

JEN:
(sadly)
I know, it’s not exactly a desirable trait in the dating world.

AIDEN:
(smiling)
Well, I’m not like most guys. I think it’s pretty cool, to be honest.

Jen’s eyes glitch again, this time in surprise.

JEN:
(surprised)
Really?

AIDEN:
(nodding)
Really. Plus, I always thought I’d make a great cyborg myself.

Jen smiles and takes Aiden’s hand, feeling grateful for the first time to have found someone who accepts her for who she really is.

They continue to look at the book, their fingers touching.

Aiden turns to Jen, looking into her eyes.

AIDEN:
(softly)
You know, I may not be able to dream like you do, but
I have a feeling this is the beginning of something special.

JEN:
(smiling)
I have that feeling, too.

They lean in and share a kiss, the start of their unconventional love story.”

And then it rated “our” scene a B+. This AI passes the Turing Test for sure.

Better Script Notes

Jason Hellerman, writing for No Film School, explains How to Critique a Screenplay (While Not Being a Dick).

He begins with:

“Screenplay critiques serve many purposes in the screenwriting process. First and foremost, they offer valuable feedback to the writer, identifying strengths and weaknesses in their work. This feedback helps writers refine their scripts, making them more engaging and effective.”

Jason distinguishes the various types of notes:

  1. Coverage: Coverage is a summary and evaluation of a script, typically prepared by a script reader or industry professional. It provides an overview of the script’s strengths and weaknesses and includes a recommendation on whether the script should be considered for further development or production.
  2. Development notes: Development notes focus on the creative aspects of the script, offering suggestions for improving the story, characters, and dialogue. These notes are typically prepared by producers, development executives, or other industry professionals involved in the development process.
  3. Writer-to-writer notes: These notes are provided by fellow writers, offering feedback and suggestions from a writer’s perspective. They can be informal, such as comments exchanged in a writers’ group, or more structured, such as a script swap or feedback session.
  4. Line edits: Line edits focus on the script’s grammar, spelling, and formatting. These notes are typically prepared by a script editor or proofreader and help ensure the script is polished and professional.

Jason provides some best practices for giving feedback:

  1. Read the script thoroughly: To provide meaningful feedback, you need to have a deep understanding of the script. Take the time to read it carefully, and make notes as you go. This will help you identify areas for improvement and provide specific examples when offering feedback.
  2. Focus on the big picture: Before diving into the details, consider the script’s overall structure and story arc. Are there any plot holes or inconsistencies? Are the characters well-developed and engaging? Addressing these fundamental issues should be your priority when giving notes.
  3. Be specific: When offering feedback, provide clear examples and explanations to support your observations. This will help the writer understand your perspective and make it easier for them to address the issues you’ve identified.
  4. Offer actionable suggestions: Instead of simply pointing out problems, provide suggestions for how to improve the script. This will make your feedback more valuable and help the writer feel empowered to make changes.
  5. Be respectful and supportive: Remember that your goal is to help the writer improve their script, not to tear them down. Offer praise for the aspects of the script that work well, and be empathetic and understanding when offering criticism.
  6. Don’t be a dick: Seriously, I don’t know how many times I have to add this in there. Your job is to help. Not hinder.

Jason recommends a critique template that covers:

  1. Story/Plot: Does the story have a clear and compelling arc? Are there any plot holes or inconsistencies?
  2. Characters: Are the characters well-developed and interesting? Do their actions and dialogue feel authentic and consistent with their personalities?
  3. Dialogue: Is the dialogue realistic and engaging? Does it move the story forward or feel extraneous?
  4. Pacing: Is the story paced effectively? Does it feel too slow or rushed at any point?
  5. Structure: Is the screenplay structured effectively? Does it follow the traditional three-act structure or another effective structure for the genre?
  6. Themes: Are there any themes or messages conveyed in the story? Are they effectively communicated?
  7. Tone: Is the tone consistent throughout the screenplay? Does it fit the genre and subject matter?
  8. Setting/World-building: Is the setting or world of the story well-established and believable?
  9. Visuals: Are there any scenes that would be particularly visually striking on screen? Are there any scenes that could be cut or condensed to improve the visual storytelling?
  10. Overall Impression: What is your overall impression of the screenplay? Would you recommend it for production?

My take: When folks ask me to read their work, I always agree and then ask them what they’re looking for. I praise what I love and strive to provide at least a couple of suggestions for improving problematic bits. Hopefully one idea triggers something the writer can run with and make their own.

Over 50 Screenwriting Maxims

Jason Hellerman lists on No Film School — An Exhaustive List of Screenwriting Maxims and Their Definitions!

And here they are:

  1. Show, Don’t Tell
  2. Start Late, Leave Early
  3. Three-Act Structure
  4. Character Arc
  5. Conflict is Key
  6. Save The Cat
  7. Kill Your Darlings
  8. Every Scene Must Serve a Purpose
  9. Subtext is Essential
  10. The Inciting Incident
  11. Plant and Payoff
  12. Write What You Know
  13. Dialogue Should Be Distinctive and Purposeful
  14. The Hero’s Journey
  15. Pacing is Critical
  16. Less is More
  17. The Rule of Three
  18. Chekhov’s Gun
  19. Enter Late, Exit Early
  20. The Magic of Reversals
  21. Obligatory Scene
  22. Emotional Truth
  23. Suspension of Disbelief
  24. The Inner Journey
  25. Setups and Payoffs
  26. Foreshadowing
  27. Write Visually
  28. The All Is Lost Moment
  29. Raise the Stakes
  30. Voice of the Character
  31. Catharsis
  32. Mystery vs. Suspense
  33. The Moral Premise
  34. As You Write, Think and Edit
  35. Dialogue as Subtext
  36. Economy of Characters
  37. The Antagonist’s Strength
  38. Character Consistency
  39. Action Speaks Louder Than Words
  40. The Hook
  41. Scene Transitions
  42. Balance of Dialogue and Action
  43. The Lie Your Character Believes
  44. Escalation
  45. Parallel Storylines
  46. Avoid On-the-Nose Dialogue
  47. The Midpoint Reversal
  48. Theme Embodied in Characters
  49. Visual Metaphors
  50. Use of Silence
  51. Juxtaposition
  52. The False Victory or Defeat
  53. Use of Recurring Motifs.

For explanation, see Jason’s list.

My take: I’ve tried to use every single one at one point or another. 😉