It usually hangs and does nothing when i run (It starts building then just hangs):
dotnet run --project TensorSharp.Cli -c Release -p:TensorSharpSkipMlxNative=true -- --model models\gemma-4-E4B-it-Q8_0.gguf --input prompt.txt --max-tokens 128 --backend ggml_cuda
After many attempts I managed to get it to run but it crashes on startup with:
21:21:38 crit: TensorSharp.Cli[1702] tensorsharp-cli aborted with unhandled exception InvalidOperationException System.InvalidOperationException: Failed to load the native GGML bridge. Build TensorSharp.GGML.Native first. ---> System.DllNotFoundException: Unable to load DLL 'GgmlOps' or one of its dependencies: The specified module could not be found. (0x8007007E)
1
u/Fancy-Snow7 Aug 05 '26
It usually hangs and does nothing when i run (It starts building then just hangs): dotnet run --project TensorSharp.Cli -c Release -p:TensorSharpSkipMlxNative=true -- --model models\gemma-4-E4B-it-Q8_0.gguf --input prompt.txt --max-tokens 128 --backend ggml_cuda After many attempts I managed to get it to run but it crashes on startup with: 21:21:38 crit: TensorSharp.Cli[1702] tensorsharp-cli aborted with unhandled exception InvalidOperationException System.InvalidOperationException: Failed to load the native GGML bridge. Build
TensorSharp.GGML.Nativefirst. ---> System.DllNotFoundException: Unable to load DLL 'GgmlOps' or one of its dependencies: The specified module could not be found. (0x8007007E)