← All news & events

News

US patent granted for memory allocation on NUMA machines

US 12,314,761, granted on May 27, 2025, describes NUMAlloc, an allocator that keeps a thread's memory on the thread's own node and spreads shared objects across nodes. Teyon founder Tongping Liu is the lead inventor.

Four NUMA nodes, each thread allocating on its own node's memory, above an interleaved heap spread across the nodes

What the patent covers

The United States Patent and Trademark Office granted US 12,314,761, System and method for memory allocation and management in non-uniform memory access architecture computing environments, on May 27, 2025. The inventors are Tongping Liu, Teyon's CEO and technical founder, with Hanmei Yang and Xin Zhao. The application was filed on April 11, 2022, with priority to February 12, 2021, and the patent is assigned to the University of Massachusetts Amherst, where the work was done.

On a NUMA machine every processor has memory of its own, and touching another processor's memory is slower. The patented allocator, NUMAlloc, binds memory regions and threads to physical nodes and uses that binding to keep both new allocations and freed objects local to the thread that asked for them. It also shares transparent huge pages incrementally and keeps an interleaved heap that spreads the main thread's shared objects across nodes, so no single node carries the load for everyone.

Read more

The allocator is described in NUMAlloc (ISMM 2023). The granted patents naming our founder are listed on the Resources page.

Source: Google Patents, US12314761B2.

Original source ↗← Back to news