Friday, September 21, 2007

Recent Links for 09/21/2007

Newbie - converting csv files to arrays in NumPy
Great message thread on how to convert csv files to numpy arrays.
Cookbook/InputOutput - Numpy and Scipy
File processing examples using numpy, scipy, and matplotlib. How to read/write a numpy array from/to ascii/binary files.
Numpy Example List
Examples of Numpy functions such as fromfile(), hsplit(), recarray(), shuffle(), sort(), split(), sqrt(), std(), tofile(), unique(), var(), vsplit(), where(), zeros(), empty(), and many more.
Introducing Plists: An Erlang module for doing list operations in parallel
Could you spawn a trading system process for each stock of a given day's trading (a list)? What if you had 20,000 stocks for a given day? Can plists/erlang handle 20,000 processes without hitting memory constraints?

2 comments:

wingedsubmariner said...

Thanks for the link :)

Erlang can support an order of magnitude more than 20,000 processes. The Yaws web server, written in Erlang, handled 80,000 concurrent connections while still delivering data http://www.sics.se/~joe/apachevsyaws.html . plists can certainly start 20,000 processes, and memory per process starts below 400 bytes, so memory usage depends almost entirely on your own code.

Michael Taylor said...

Thanks for the comment wingedsubmariner! That's pretty amazing in regard to the Yaws web server handling 80,000 concurrent connections. I guess, I'll have to dig into Erlang and experiment a bit.

Thanks again,

MT