The parallel computation of large number of small dense matrix operations (multiply, LU decomposition, triangular solve) is a perfect fit for implementation a GPU, which can achieve vastly more throughput than modern CPUs can.
using the CPU's neighborhood structure on the GPU has a crippling bottleneck.