This really isn't the venue for this issue. The best resource I could find is https://www.microsoft.com/en-au/microsoftfeedback/
PLS REPLY- False Advertising issue?
To Whom It May Concern,
Subject: Formal Complaint Regarding Misleading Advertising and Performance of Snapdragon X Elite NPU on Microsoft Surface Pro 11
I am writing to formally raise a complaint concerning the advertised capabilities of the Qualcomm Snapdragon X Elite Neural Processing Unit (NPU) as featured in the Microsoft Surface Pro 11 (11th Gen). Based on extensive, independent benchmarking and testing, the NPU’s real-world performance for large language model (LLM) inference is significantly inferior to the CPU-only mode, directly contradicting explicit marketing claims made by both Microsoft and Qualcomm.
Summary of Findings:
The NPU inference speed is over 12 times slower than CPU inference for the tested Llama 3.2 3B Chat model (8K context) under AnythingLLM v1.8.4 on Windows 11 ARM64.
Despite Qualcomm and Microsoft promoting the NPU as delivering superior AI acceleration and enabling advanced on-device AI workloads, my testing conclusively shows this is not the case for transformer-based LLM workloads.
The outputs generated by NPU and CPU modes are comparable in quality, but the NPU’s latency makes it impractical for real use.
These findings expose false and misleading representations under the Australian Consumer Law (ACL), particularly Sections 18 (misleading or deceptive conduct), 29 (false or misleading representations), and 54 (goods not of acceptable quality).
Attached is my detailed In-Depth Benchmark Report and Legal Complaint documenting the testing methodology, results, technical analysis, and legal basis for this complaint.
I formally request the following remedies:
Acknowledgment of the performance discrepancies between marketed claims and actual NPU performance.
Immediate cessation of marketing that promotes the Snapdragon X Elite NPU as a viable AI accelerator for LLM workloads on the Surface Pro 11 until verifiable improvements are made.
Full refund or suitable compensation for consumers misled by these claims.
Cooperation with consumer protection authorities to ensure compliance with Australian Consumer Law.
If this matter is not resolved satisfactorily within a reasonable timeframe, I will be compelled to escalate this complaint to the Australian Competition and Consumer Commission (ACCC) and other relevant bodies.
I look forward to your prompt response addressing these concerns.
Yours sincerely,[Your Address]
[City, State, Postcode]
[Email Address]
[Phone Number]
[Date]
To Whom It May Concern,
Subject: Formal Complaint Regarding Misleading Advertising and Performance of Snapdragon X Elite NPU on Microsoft Surface Pro 11
I am writing to formally raise a complaint concerning the advertised capabilities of the Qualcomm Snapdragon X Elite Neural Processing Unit (NPU) as featured in the Microsoft Surface Pro 11 (11th Gen). Based on extensive, independent benchmarking and testing, the NPU’s real-world performance for large language model (LLM) inference is significantly inferior to the CPU-only mode, directly contradicting explicit marketing claims made by both Microsoft and Qualcomm.
Summary of Findings:
The NPU inference speed is over 12 times slower than CPU inference for the tested Llama 3.2 3B Chat model (8K context) under AnythingLLM v1.8.4 on Windows 11 ARM64.
Despite Qualcomm and Microsoft promoting the NPU as delivering superior AI acceleration and enabling advanced on-device AI workloads, my testing conclusively shows this is not the case for transformer-based LLM workloads.
The outputs generated by NPU and CPU modes are comparable in quality, but the NPU’s latency makes it impractical for real use.
These findings expose false and misleading representations under the Australian Consumer Law (ACL), particularly Sections 18 (misleading or deceptive conduct), 29 (false or misleading representations), and 54 (goods not of acceptable quality).
Attached is my detailed In-Depth Benchmark Report and Legal Complaint documenting the testing methodology, results, technical analysis, and legal basis for this complaint.
I formally request the following remedies:
Acknowledgment of the performance discrepancies between marketed claims and actual NPU performance.
Immediate cessation of marketing that promotes the Snapdragon X Elite NPU as a viable AI accelerator for LLM workloads on the Surface Pro 11 until verifiable improvements are made.
Full refund or suitable compensation for consumers misled by these claims.
Cooperation with consumer protection authorities to ensure compliance with Australian Consumer Law.
If this matter is not resolved satisfactorily within a reasonable timeframe, I will be compelled to escalate this complaint to the Australian Competition and Consumer Commission (ACCC) and other relevant bodies.
I look forward to your prompt response addressing these concerns.Llama3.2_SurfacePro11_Benchmark_Report_Legal_Complaint_Clean.pdf
Surface | Surface Pro | Performance and maintenance
Locked Question. You can vote on whether it's helpful, but you can't add comments or replies or follow the question.