由买买提看人间百态

topics

全部话题 - 话题: numba
1 (共1页)
x***u
发帖数: 297
1
帮你一下:
cpython:是用C语言实现的python,也就是大家习惯上称的python
julia:是完全不同的编程语言
cython:自称C extension for python,简单讲就是在python里写C的语句(实际上要
比这个复杂一点)
pypy:是用 python实现的python(所以叫pypy),但是很多已有的Cpython的package
不能用。
numba:可以看作是python的JIT,缺点跟pypy一样,很多package不能用。


: 麻烦把这几个名词搞清楚

l******n
发帖数: 9344
2
我的经验是
cython给c/c++写wrapper太好用了,而且cython速度很快,和c差不多。
pypy号称速度很快没有用过
numba很多用来加速python,但是限制很多,try过但是放弃
Julia感觉很火,很多公司在用,但是julia的package和python比差很多

package
a*****e
发帖数: 1700
3
Python list comprehension 可以并行啊,用 Numba 库:
http://numba.pydata.org/numba-doc/dev/reference/pysupported.html#list-comprehension
list comprehension 本身也是从 FP 来的概念,等同于 list monad,但 Python 的语
法略局限。

with
m***r
发帖数: 359
4
来自主题: Programming版 - Python日报 2015年2月楼
Python日报 2015-02-25
@好东西传送门 出品, 过刊见
http://py.memect.com
订阅:给 [email protected]
/* */ 发封空信, 标题: 订阅Python日报
更好看的HTML版
http://py.memect.com/archive/2015-02-25/short.html
1) 【Python代码优化】 by @爱可可-爱生活
关键词:工具, 库, 数据科学, IPython, 博客, 计算
[文章]《Optimizing Python in the Real World: NumPy, Numba, and the NUFFT》 [
1] 以非均匀快速傅立叶变换(NUFFT)为例介绍面向实战的Python代码优化 ipn: [2]
[1] https://jakevdp.github.io/blog/2015/02/24/optimizing-python-with-numpy-
and-numba/
[2] http://nbviewer.ipython.org/url/jakevdp.github.io/d... 阅读全帖
n******7
发帖数: 12463
5
我明白你的意思了,很好的point
我倒是也希望有一种写的容易,跑的快,包还全的语言
所以之前了解过Julia,然后因为这个benchmark的问题很失望
他们是知道大家的这个疑问,但是故意不解释也不改进代码
起码他们应该给出一个不适合矢量化的例子,用来评估裸循环的速度
你说的这个问题我在R里面遇到很多
因为R里面循环的速度是超级超级的慢
一个说法是你的循环超过100次,你就应该想办法改进代码了
但是不是每个问题都适合或者很容易矢量化的
这也是我抛弃R的一个重要原因
Python比R的情况好,也有pypy,numba这样的JIT版本,还有Cython
搜了一下,
pypy似乎总体还是不如julia
http://stackoverflow.com/questions/10775510/julias-python-performance-example-in-pypy
但是Cython numba numpy这些工具还是挺给力的,8个benchmark6个比julia快,总体可
以算持平
https://www.ibm.com/developerworks/community/blogs... 阅读全帖
p**z
发帖数: 65
6
我相信Python配合Cython和Numba使用,应该可以解决不少循环速度问题。我除了读
tutorial没有怎么太用过它们;印象是它们比较适合纯数值运算(循环内数据是简单数
据类型)。
我在应用中未来需要处理的情况是,程序主体就是多层嵌套大量循环,里面除了数值计
算还需要用到不少自定义的数据结构,而且要尽量把可以并行运算的循环扔到不同的
processor上面去;有些内层循环的计算可能要使用GPU提速。我的理解这种情况不适用
于Cython和Numba,但是我也没有仔细研究过它们所以不是100%确定。
大部分人可能没有这样的需求,用Python完全可以满足应用。
Julia的确太年轻,package数量远不如Python(目前官方注册package数是1101,http://pkg.julialang.org/;Python官方注册package数是87882,https://pypi.python.org/pypi)。Julia package的数目是在稳步增长中(http://pkg.julialang.org/pulse.html),我觉得将来在科学计算领域Julia有希望成... 阅读全帖
b********n
发帖数: 38600
7
来自主题: Military版 - 美国黑人真多
"Welcome To My Hood (Remix)"
(feat. Ludacris, T-Pain, Busta Rhymes, Mavado, Twista, Birdman, Ace Hood,
Fat Joe, Jadakiss, Bun B, Game, Waka Flocka Flame)
[DJ Khaled & T-Pain talking:]
I'm foreal about this shit, this the remix (welcome to my hood), let's go,
remix, remix, remix
(Where ya hood at, where ya hood at, where ya hood at)
[Chorus:]
Welcome to my hood, everybody know everybody and if I got it everybody got
it
Welcome to my hood, look at all these old school chevys, 24's so you know
we r... 阅读全帖
m*****n
发帖数: 3575
8
来自主题: Military版 - 中国政府的皇民化教育深入人心
马斯克此行还品尝了中国的特色美食——煎饼果子。根据新浪科技分享的一张图片来看
,马斯克同一行人在街头大快朵颐,手中拿着的显然是煎饼果子,看起来马斯克吃的还
挺香的,不知跟他们的汉堡相比马斯克作何评价。
===================================
这是凤凰网的新闻。也算小央视了吧,连街头小吃都透着个“中国天下第一”的酸劲。
这算是土鳖的洗脑教育成功吧?不过“China Numba Wan”跑到国际上就是个笑话!

发帖数: 1
9
来自主题: Military版 - 出国旅游必会英语句子
China Numba One!!

发帖数: 1
10
招聘:Junior Quantitative Developer – Pro Trading firm-芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work coll... 阅读全帖

发帖数: 1
11
招聘:Junior Quantitative Developer-Trading firm-芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collaborat... 阅读全帖

发帖数: 1
12
招聘: Junior Quantitative Developer –顶尖做市商-波士顿/芝加哥
Akuna Capital is a derivatives trading firm headquartered in downtown
Chicago that specializes in market making and arbitrage. Akuna started with
five employees in 2011 and we now have over 140. In 2014 we grew by 84%,
opening our first international office and our third U.S. office.
We are looking for a Junior Quantitative Developer to work with a strong
team of Quant Developers and Quant Traders. The successful candidate will
bring enthusiasm f... 阅读全帖

发帖数: 1
13
Hiring: Quantitative Developer- Akuna Capital –芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collabor... 阅读全帖

发帖数: 1
14
招聘:Junior Quantitative Developer-Trading firm-芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collaborat... 阅读全帖

发帖数: 1
15
Hiring: Quantitative Developer- Akuna Capital –芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collabor... 阅读全帖
c****u
发帖数: 8308
16
来自主题: Texas版 - 今天去三和吃饭,气着了
女: “Watch it! Are you fucking black?"
楼主双腿不对称地一软, 开始 rap:
"yo, yo whatey up, daug. chill'ya cheek"
"dont mad me 'coz me the SteveeKey."
"numba 1 hole digger yeah the king of MIT"
"me like the asian folk like tommrrow aint no more cheese"
"aint like the unfair daugy being smashy Lee"
"so dont hate the player my girl hate the pee"
"'coz this's texas and my sizey matters all the homie"
"yo...all the homie...嗯哼...yo...everybody...嗯哼...yo...all the homie...嗯哼...yo everybody...嗯哼...yo...that's rite...... 阅读全帖
l***z
发帖数: 61
17
可以试试numba库,给函数加上@jit,把python自动编译成llvm,性能应该会提高不少。
v*******e
发帖数: 11604
18
这些能够把python弄快的东西,为什么都不是python主流?难道有致命缺陷吗?
m*******e
发帖数: 1598
19
开发时间 >> 运行时间
e*******o
发帖数: 4654
20
麻烦把这几个名词搞清楚
c******n
发帖数: 16666
21
Julia
w*****g
发帖数: 16352
22
朱丽娅的OOP很怪异,不习惯,快是快点,如果把东西都放在func里。

★ 发自iPhone App: ChineseWeb 13
g****t
发帖数: 31659
23
来自主题: Programming版 - [bssd]汇报一下Julia进展
结论:Julia值得试一个月。
0。
最大的信心在于,emacs julia看着还行。
org mode 里julia也还行。
如果有什么坑,我相信在org-mode环境下,
可以用python方便的补一下。
1。
我只打算用最少的,今后不会改变的语法特点。
Julia语法我很满意,熟悉python,matlab的看一下cheat sheet
直接写就可以了。
2。
Python+numpy+numba+cpython等方式
我不会去尝试,因为今后可能会不稳定,并且有不少的ad hoc
trick。
3。
不求Julia性能和C一样。
希望Julia能够让快速开发阶段晚一点结束。
量化来讲。下面有两个情况
情况一:
在某个步骤,例如算梯度,开发10个算法变种,带数据测试比较。
这种情况可以用python。因为就是10个算法跑一下。
慢一点没关系。
情况二:
在某个步骤,例如算梯度,开发10个算法变种,步长10个变种,
带数据测试比较。
这种情况没办法用python。因为是10×10个算法跑。太慢了。
3。
那么快速开发后进行算法变种的较大规模测试的情况,
最后实际上还是只能重写成C++... 阅读全帖
a*****e
发帖数: 1700
24
来自主题: Programming版 - python下怎么解决GIL?
用 numba 啊
m*****n
发帖数: 3575
25
你是怎么装Numba的?不是Anaconda只支持Numpy么?
a*****e
发帖数: 1700
26
没这个说法吧,anaconda 装 numba 没问题,我从 source 装也没问题
b****u
发帖数: 1130
27
来自主题: Programming版 - 大家用python 调用C++是如何搞的
用cython,swig, ctypes, boost python.
哪个用起来比较好?
我现在懒,简单的用numba标注来优化循环代码。
w***g
发帖数: 5958
28
来自主题: Programming版 - 大家用python 调用C++是如何搞的
我用boost python可以,用python/numpy的C接口也方便。
numba似乎不错,不过我还没学到。
别的无法用apt-get或pip装的奇技淫巧,年纪大了都不感兴趣了。
a*****e
发帖数: 1700
29
来自主题: Programming版 - 看到python的multiprocessing心中一痛
如果你是要做并行计算,可以试试 Numba 最新的版本,@njit(parallel=True) 就好了。
b****u
发帖数: 1130
30
C++ OOP固然强大,但很难编,维护麻烦,找人干活也麻烦。我也很久没用了。
Python固然方便。到了优化的部分其实还是借助其他接口,比如numpy, numba, etc,
本质还是用其他语言搞,最后不三不四,最后花的时间更多。
感觉不如把核心算法用C给做了。开个接口给python用。
上次有人贴链接,我就看了一下魏老师和卫东的C++代码,说实话,看上去奇丑无比,
但是效率可能非常高。
其中的美我有点不会欣赏。一个人做当然没问题,要是一个小团队搞这个就不好弄了。
b****u
发帖数: 1130
31
C++ OOP固然强大,但很难编,维护麻烦,找人干活也麻烦。我也很久没用了。
Python固然方便。到了优化的部分其实还是借助其他接口,比如numpy, numba, etc,
本质还是用其他语言搞,最后不三不四,最后花的时间更多。
感觉不如把核心算法用C给做了。开个接口给python用。
上次有人贴链接,我就看了一下魏老师和卫东的C++代码,说实话,看上去奇丑无比,
但是效率可能非常高。
其中的美我有点不会欣赏。一个人做当然没问题,要是一个小团队搞这个就不好弄了。

发帖数: 1
32
Hiring: Quantitative Developer- Akuna Capital –芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collabor... 阅读全帖

发帖数: 1
33
招聘:Junior Quantitative Developer-Trading firm-芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collaborat... 阅读全帖

发帖数: 1
34
Hiring: Quantitative Developer- Akuna Capital –芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collabor... 阅读全帖

发帖数: 1
35
招聘:Junior Quantitative Developer-Trading firm-芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collaborat... 阅读全帖

发帖数: 1
36
Hiring: Quantitative Developer- Akuna Capital –芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collabor... 阅读全帖
k*******d
发帖数: 1340
37
来自主题: Quant版 - Python 替代 R, 好使吗?
R的统计算法多,适合做研究
Python适合做production,如果小心使用速度上和内存占用上可以比R块一些。提高数
值计算速度有各种办法,比如Cython, Numba, Numexpr, numpy/scipy/sklearn/
statmodels则是标准装备
k*******d
发帖数: 1340
38
来自主题: Quant版 - Python 替代 R, 好使吗?
numba/Cython/numexpr可以用python的语法写代码,然后生成C代码或者直接生成
machine code,开发起来比较容易,不过一般只对数值计算有好的加速效果
k*******d
发帖数: 1340
39
来自主题: Quant版 - Python 替代 R, 好使吗?
numba/Cython/numexpr可以用python的语法写代码,然后生成C代码或者直接生成
machine code,开发起来比较容易,不过一般只对数值计算有好的加速效果
k*******d
发帖数: 1340
40
来自主题: Quant版 - Python 替代 R, 好使吗?
numba/Cython/numexpr可以用python的语法写代码,然后生成C代码或者直接生成
machine code,开发起来比较容易,不过一般只对数值计算有好的加速效果

发帖数: 1
41
招聘:Junior Quantitative Developer – Pro Trading firm-芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work coll... 阅读全帖

发帖数: 1
42
招聘:Junior Quantitative Developer-Trading firm-芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collaborat... 阅读全帖

发帖数: 1
43
招聘: Junior Quantitative Developer –Akuna Capital-波士顿
Akuna Capital in Cambridge is hiring! We are looking for someone with a
Masters or Ph.D. in a technical field, 1+ years of Python experience
developing applications, and a strong quantitative background to join our
team! This successful candidate will bring enthusiasm for problem solving
and will assist our team in maintaining existing quantitative infrastructure
and the development of new data analysis, quantitative visualization and
modeling... 阅读全帖

发帖数: 1
44
招聘: Junior Quantitative Developer –Akuna Capital-波士顿/芝加哥
Website: www.akunacapital.com
Akuna Capital is a derivatives trading firm headquartered in downtown
Chicago that specializes in market making and arbitrage. Akuna started with
five employees in 2011 and we now have over 140. In 2014 we grew by 84%,
opening our first international office and our third U.S. office.
We are looking for a Junior Quantitative Developer to work with a strong
team of Quant Developers and Quant Traders. The succes... 阅读全帖

发帖数: 1
45
Hiring: Quantitative Developer- Akuna Capital –芝加哥
Akuna Capital is a fast-growing trading house that specializes in derivative
market-making and arbitrage. We pair up experienced and talented traders
with industry-leading low latency IT, giving the company a huge advantage in
the dynamic screen-based trading sphere. Founded in 2011, the company
trades on major derivative markets across the US, our offices are in Chicago
, Shanghai, Champaign and Boston.
Our traders and developers work collabor... 阅读全帖
1 (共1页)