Skip to content

User Issue: Server 500 error when /POST to localhost #5

Description

@twelsh37

System:
Intel i9-14900KF
RAM 192GB
GPU RTX 4090 24GB
Windows 11 v 23H2

Ollama
ollama version is 0.5.4

My Issue
I have followed your guide and have updated my .env in both the root of the project and in server/
I accessed ISO Speed Bench and loaded simple_math.yaml.
This used the following models:

models:
  - "llama3.2:1b"
  - "llama3.2:latest"
  - "qwen2.5-coder:14b"
  - "falcon3:10b"
  - "phi4:latest"

Which corresponds with my Ollama Models

E:\data\Projects\benchy>ollama list
NAME                       ID              SIZE      MODIFIED
all-minilm:latest          1b226e2802db    45 MB     6 hours ago
falcon3:10b                1653ff122acd    6.3 GB    7 hours ago
qwen2.5-coder:14b          3028237cc8c5    9.0 GB    14 hours ago
qwq:32b                    46407beda5c0    19 GB     14 hours ago
deepseek-coder:33b         acec7c0b0fd9    18 GB     19 hours ago
qwen2.5:32b                9f13ba1299af    19 GB     19 hours ago
gemma2:27b                 53261bc9c192    15 GB     20 hours ago
llama3.2:latest            a80c4f17acd5    2.0 GB    20 hours ago
llama3.2-vision:latest     085a1fdae525    7.9 GB    20 hours ago
llama3.2:1b                baf6a787fdff    1.3 GB    20 hours ago
mistral:latest             f974a74358d6    4.1 GB    20 hours ago
phi4:latest                ac896e5b8b34    9.1 GB    20 hours ago
nomic-embed-text:latest    0a109f422b47    274 MB    21 hours ago

The tests all run and then at the end it gets a 500 error.
I know the server is running as I see the following output in it;

 Running test 26/30...
  Running test 27/30...
  Running test 28/30...
  Running test 29/30...
  Running test 30/30...
Generating report for Simple Math in Python
127.0.0.1 - - [12/Jan/2025 11:05:53] "POST /iso-speed-bench HTTP/1.1" 500 -

I'm new to flask, but everything looks fine.
Any pointers as to where I am going wrong?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions