Prompting in interactive mode and specifying different images reuses the first image

[beaugunderson]

Describe the bug

Prompting in interactive mode and specifying different images reuses the first image, e.g.:

> \image https://niche-museums.imgix.net/pioneer-history.jpeg?w=1600&h=800&fit=crop&auto=compress <|image|> describe this image including any text

The image shows the exterior of the Daughters of Utah Pioneers (DUP) Museum, which is also known as the DUP Museum. The building is located in Salt Lake City, Utah, USA.

Visible in the image are:

1. **The DUP Museum Building**: The main structure of the museum is a prominent feature in the image. It appears to be a two-story building with a rectangular shape and a flat roof. The exterior walls are made of brick or stone, giving it a classic and historic appearance.

2. **Signage**: Above the entrance of the building, there is a sign that reads "Daughters of Utah Pioneers Museum." This sign indicates the name and purpose of the building.

3. **Entrance**: The main entrance to the museum is visible, with a doorway flanked by columns or pillars, suggesting a formal and structured design.

4. **Surrounding Landscape**: The image captures the surrounding area around the museum, which appears to be a well-manicured lawn with some trees and possibly other buildings in the background.

5. **Additional Details**: There are some additional architectural details visible, such as windows, doors, and possibly decorative elements like cornices or moldings on the building's facade.

The Daughters of Utah Pioneers (DUP) Museum is dedicated to preserving and showcasing the history and heritage of Utah's early pioneers. The museum likely contains exhibits and artifacts related to Utah's pioneer history, including historical documents, photographs, clothing, tools, and other items from the early settlers.

The image captures the physical structure and setting of the DUP Museum, providing a visual representation of its location and architectural style.
>
> \image ../../search-results/7.jpg  <|image|> describe this image including any text
The image shows a close-up view of a historical marker or plaque located near the Daughters of Utah Pioneers (DUP) Museum in Salt Lake City, Utah. The plaque appears to be mounted on a stone or concrete base and has an inscription that reads:

"Daughters of Utah Pioneers"

The inscription is simple and straightforward, indicating that this marker is associated with the DUP organization. The DUP is an organization that honors and preserves the history of Utah's early pioneers.

There are no other notable features or additional text on the plaque beyond the name of the organization. The focus is solely on identifying the location and purpose of the marker.

This historical marker serves as a commemorative element, acknowledging the contributions and legacy of the DUP in preserving Utah's pioneer history.
> \exit

In this case, ../../search-results/7.jpg is a completely different image. I also tested using two local images, as opposed to one remote image and one local image, and found the same behavior.

Latest commit or version

Which commit or version you ran with.

32e8945

$  cargo run --features metal --release -- -i --isq Q4K vision-plain -m lamm-mit/Cephalo-Llama-3.2-11B-Vision-Instruct-128k -a vllama

[EricLBuehler]

@beaugunderson thanks for reporting this. I am actively working on a fix.