Hardware for data crunching and large arrays
Posted: 30 Nov 2020, 22:48
I’m looking to up grade my hardware specifically for running autohotkey scripts. These scripts have to calculate many averages and other functions on every element of every array, but its taking ages to crunch the results. There’s a 3 dimensional cube testing combinations and each of those combinations have 40-70 arrays with 2 years of data accounting for each minute (2*365*24*60 = 1,051,200 elements in each* array in each combination)
The combinations dimensions are 50,128,12
Memory is not much of a problem I don’t think since each array is cleared after each combination is calculated in the grid. Keep in mind there are many functions being executed on every element of each array.
My question is what factors should I consider when buying a cpu or motherboard so I can run these simulations quicker? Would a duel cpu motherboard be a good option? Were crunching this data on a blockchain network, but we want to make this as centralized as possible.
The combinations dimensions are 50,128,12
Memory is not much of a problem I don’t think since each array is cleared after each combination is calculated in the grid. Keep in mind there are many functions being executed on every element of each array.
My question is what factors should I consider when buying a cpu or motherboard so I can run these simulations quicker? Would a duel cpu motherboard be a good option? Were crunching this data on a blockchain network, but we want to make this as centralized as possible.