One of the most noticeable upgrades Intel made to its latest Core Ultra 7 270K Plus and 250K Plus CPUs was the introduction of its Binary Optimization Tool that manipulates instructions at the hardware level to boost IPC. The tool is highly beneficial for squeezing extra performance out of the Arrow Lake architecture, but it has led to concerns over benchmarking accuracy and consistency with these chips. John Poole from Geekbench posted a warning to its users that Intel's latest tool can't be trusted at this time, and there's no way to identify when the tool is enabled or disabled during a benchmark run.
Pool revealed that Intel does not have any public documentation on the techniques the Binary Optimization Tool (or iBOT) uses to optimize code, making it difficult to determine how effective iBOT's techniques are when applied to a variety of different applications. Furthermore, this problem makes it impossible for Primate Labs (the makers of Geekbench) and its userbase to understand how iBOT is boosting performance compared to benchmarks that run without it. According to Poole, Geekbench 6 workload scores on the chips increase by up to 40% with iBOT enabled, with overall scores improving by up to 8%. "Since the tool modifies the benchmark, and it is unclear to both Primate Labs and the general public how these changes occur," he warned.
