Baidu deploys Intel Optane DC memory and latest Xeon processors

Intel has revealed that Baidu is advancing its Feed Stream services to deliver personalized content to its customers.
Baidu search engineBaidu uses an advanced in-memory database called Feed-Cube to support data storage and information retrieval in its cloud-based Feed Stream services.

Baidu will be deploying Intel Optane DC persistent memory and 2nd Gen Intel Xeon Scalable processors to ensure high concurrency, large capacity and high performance for Feed-Cube.

Intel and Baidu architected a hybrid memory configuration that includes both Intel Optane DC persistent memory and DRAM within the Baidu Feed Stream services.

Feed-Cube achieved a boost in search result response times under the pressure of large concurrent access. Single-server DRAM usage dropped by more than half, which reduces costs in terms of the petabyte-level storage capacity of Feed-Cube.

Intel and Baidu have published a detailed case study of this work, including examples of other applications using Intel Optane DC persistent memory technology, such as Redis, Spark and function-as-a-services.

“Using Intel Optane DC persistent memory within the Feed-Cube database enables Baidu to cost-effectively scale memory capacity to stay on top of the continuously expanding demands placed on our Feed Stream services,” said Tao Wang, chief architect, Recommendation Technology Architecture at Baidu.

Chinese Internet giant is architecting the in-memory database of its Feed Stream services to use capabilities of Intel Optane DC persistent memory as part of the strategy to lower its total cost of ownership (TCO) while delivering more personalized search results to users.

Intel and Baidu disclosed details of this deployment and other collaborations on Thursday at the 2019 Baidu ABC Summit in Beijing.

Jason Grebe, Intel corporate vice president and general manager of the Cloud Platforms and Technology Group

Intel and Baidu unveiled a storage solution to accelerate machine learning performance in high-performance computing workloads. The HPC solution is offered in Baidu’s cloud environment and provides HPC support covering a range of capabilities. The Baidu Cloud ABC Storage service uses Intel Optane DC SSDs and Intel QLC 3D NAND SSDs.