Generate authentic scenarios from images/visuals

Introduction

In technical and STEM disciplines, student mastery is built through repetition and varied application. However, creating a continuous stream of realistic troubleshooting scenarios—like analyzing a complex HVAC system or debugging code—is a significant pedagogical hurdle that can lead to stagnant assessments and academic integrity challenges.

In your current curriculum, where is the 'visual logic' most difficult for students to understand?

Today, we’ll address this challenge by using multimodal AI without increasing your administrative load. We’ll explore how analyzing real-world imagery can produce unique, dynamic scenarios that keep course content relevant.

We’re using multimodal AI to process visual evidence—like a specific equipment state, a circuit board, or a lab readout to ground your assessments in the applied evidence of your field.

This approach shifts the student's focus from recall to interpretation using visual representations of what they may encounter as professionals. Locating materials, recreating models, and transporting parts or elements may not be a realistic option for you. By leveraging Gemini, you can create detailed images that will help facilitate deeper understanding in your class.

While the AI handles the logistics of generating unique, image-based variations, you remain the lead architect. You provide the expertise that analyzes the AI's output, ensuring every scenario is factual and accurate, appropriately mirroring the scenarios your students will face in professional practice.

Demo

Consider a scenario in an applied engineering course where students must diagnose a system failure. By uploading a photo of an HVAC manifold gauge displaying abnormal pressure, we can prompt Gemini to analyze that specific state.

Step 1: Open gemini.google.com

Step 2: Do a quick search for a Creative Commons "HVAC manifold gauge high pressure reading" image.

• Copy or save the image

Step 3: Upload or paste the image in the prompt box

Step 4: Enter the following prompt

I am an instructor. Analyze the pressure readings in this image and generate three troubleshooting questions that require a diagnosis based on these specific visual cues. Provide a rubric for consistent grading.

What are your key observations about the AI's ability to interpret these specific visual cues, and how might this approach influence your assessment design?

Practice

Now, identify a visual component central to your curriculum—a chart, a specific piece of equipment, or a lab schematic and develop a customized problem set.

Your task:

1. Open gemini.google.com

2. Click the plus (+) or image icon next to the chat box to upload an image from your computer.

3. Enter your prompt.

You’re also welcome to complete these instructions:

1. Search for an image of a plant cell under a microscope

2. Save or copy the image

3. Enter this prompt:

I teach intermediate undergraduate biology students. Analyze this uploaded image of a plant cell under a microscope. Generate a 3-question problem set that requires students to identify the visible organelles and hypothesize what would happen to the cell if the central vacuole ruptured. Ensure the questions require critical thinking. Format as a student-facing worksheet, followed by an instructor answer key.

Review & Refine: Review the output closely. Does the answer key accurately reflect the nuances of the image? If not, ask Gemini to correct its interpretation or add more detail.

In Person Peer Review (2 mins):

Turn to a partner and share your image and one of the generated questions.

How does this visual context prevent a student from simply searching for the answer?

Virtual Reflection (2 mins):

Reflecting on the output, how does this visual context prevent a student from simply searching for the answer?

Reflection

Reflect on the integration of these AI-assisted assessments into your syllabus.

• How might you use these visual scenarios to provide targeted support for specific learning gaps in your course? How might you incorporate assessments that are useful for differently abled students, such as those with vision impairments?

  • Which concepts in your course are the most difficult to "visualize"?
  • How might you encourage students to use AI to deepen their understanding?

Integrating image analysis into your assessment strategy transitions students from passive identification to active troubleshooting. As a final step, export the problem set you developed to Google Docs for immediate use in your next instructional session.