Skip to content

UBSAN: runtime error: member access within null pointer of type #257

Description

@JohnSmithBH84

Prerequisites

Before submitting your issue, please ensure the following:

  • [v] I am running the latest version of PowerInfer. Development is rapid, and as of now, there are no tagged versions.
  • [v] I have carefully read and followed the instructions in the README.md.
  • [v] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).

Expected Behavior

No problem reported by UBSAN

Current Behavior

PowerInfer/build/bin/finetune
error loading model: llama_model_loader: failed to load model from 

llama_load_model_from_file_with_context: failed to load model
PowerInfer/ggml.c:19835:23: runtime error: member access within null pointer of type 'const struct gguf_context'

Environment and Context

PowerInfer: master

compiler: gcc (Debian 12.2.0-14) 12.2.0

  • Physical (or virtual) hardware you are using, e.g. for Linux:

Ubuntu 22.04.4 LTS
Linux 5.15.0-125-generic #135-Ubuntu SMP Fri Sep 27 13:53:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Failure Information (for bugs)

Please help provide information about the failure / bug.

Steps to Reproduce

Launched PowerInfer/build/bin/finetune

I’ve scanned PowerInfer with UBSAN and it has triggered on PowerInfer/ggml.c line 19835. I'm not sure whether this is an actual issue, or whether code of PowerInfer is too sophisticated for UBSAN to understand. Do you guys have any idea?

Failure Logs

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions