Memory Error when numpy.dot(A,B), where A is 250000x108 float matrix, B is transpose of A

StackOverflow https://stackoverflow.com/questions/7914816

  •  14-02-2021
  •  | 
  •  

Question

Any idea of do A dot B, without Memroy Error?

Était-ce utile?

La solution

The result would be a 250000x250000 matrix, and would require about half a terabyte of RAM.

Did you mean numpy.dot(B, A)?

Autres conseils

The dot product you are trying to calculate produces a 250000x250000 array, which will require 500Gb of memory if you are using the default double precision floating point. Are you sure that is what you need?

Licencié sous: CC-BY-SA avec attribution
Non affilié à StackOverflow
scroll top