Samson's Weblog » Ruby

Downgrade Rubygems

Samson Wu — Mon, 05 Dec 2011 13:09:53 +0000

First let’s list 2 truths here:

Rails 2.3.5 will fail with RubyGems 1.5.0 +
Rails 2.3.11 will fail with RubyGems 1.7.0 +

So what if you want to deploy or run an application which unfortunately still or initially written in rails 2, given the situation that latest RVM default install rubygems version 1.8.11?

It turns out to be not so painful, cause it’s as simple as just issue one command (take 1.4.2 for example):

gem update --system 1.4.2

Just like the China highway train, sometimes what you need to do is just to stop moving so fast.

ArchLinux, RVM, Ruby, Rails, Nginx, Passenger and You

Samson Wu — Wed, 30 Mar 2011 13:50:08 +0000

没看错，就是ArchLinux，怎么，又回来了？其实我一直未曾离开…… ⁱ

好了不矫情了，let’s do business.

[Overview]
本文介绍如何在archlinux上快速搭建rails开发环境，其中有很多可能包括我个人的preferences，各位完全可以根据自行需要取舍。

[ArchLinux]
参照Arch自己的 Official Install Guide ⁱⁱ 安装，其实根本不用参照，整个安装wizard做的已经非常非常user friendly了，我觉得。

[RVM]
RVM 的安装依赖 git 和 curl：

$ sudo pacman -S git curl

装之：

$ bash < <( curl http://rvm.beginrescueend.com/releases/rvm-install-head )

注意没有sudo，符合homebrew的philosophy，尽量不要root，何况我们还是作为development环境，rvm官网好像现在已经没有倾向性了，不过我印象中以前也是倾向于装在user的home目录。

同样是非常友好的安装过程，参照提示，在.bash_profile或者.bashrc的最后添加一行 Load 代码（如果你用的是bash的话）：

$ echo '[[ -s "$HOME/.rvm/scripts/rvm" ]] && . "$HOME/.rvm/scripts/rvm"' >> ~/.bashrc

我还喜欢shell补全，如果你也喜欢，再加上一句即可：

$ echo '[[ -r $rvm_path/scripts/completion ]] && . $rvm_path/scripts/completion' >> ~/.bashrc

最后查看一下notes，看看所在平台有什么注意事项：

$ rvm notes

[Ruby]
这里我们用rvm安装ruby，如果你喜欢也可以pacman -S之，我查了下，arch repo里的ruby是1.9.2，patch level也是最新的180，不过rvm的好处是可以安装好几个ruby版本，且能够非常方便的帮你维护不同的gemset，非常像python里面的virtualenv.

安装最新的ruby 1.9.2:

$ rvm install 1.9.2

如果需要也可以装上1.8.7的：

$ rvm install 1.8.7

下载编译安装完后我们就可以使用了，我喜欢把ruby 1.9.2，gemset rails3作为我的default：

$ rvm use 1.9.2@rails3 --create --default

verify一下我们是否还是 so far so good：

$ which ruby
/home/samson/.rvm/rubies/ruby-1.9.2-p180/bin/ruby
$ ruby -v
ruby 1.9.2p180 (2011-02-18 revision 30909) [x86_64-linux]

[Rails]
安装rails 3，最新的是3.0.5:

$ gem install rails

$ which rails
/home/samson/.rvm/gems/ruby-1.9.2-p180@rails3/bin/rails
$ rails -v
Rails 3.0.5

创建一个project做demo：

$ rails new demo

bundle一下，确保所有依赖的gem都已安装，这里会把sqlite3给补上:

$ cd demo
$ bundle

又一个milestone，测试一下：

$ rails s

[Nginx & Passenger]
不用apache，让我们换nginx玩玩；由于passenger的nginx模块安装的时候需要重新编译nginx，所以 pacman -S nginx 似乎是没有意义的，我们这里先skip掉，先安装passenger，然后在编译安装passenger的nginx模块的时候把nginx一并搞定。

安装passenger：

$ gem install passenger

安装passenger的nginx模块，同时安装nginx，默认的nginx安装地址是/opt/nginx（可以修改到不需要root的地址），需要root，我们可以用rvmsudo搞定：

$ rvmsudo passenger-install-nginx-module

again，友好至极，装完连配置文件都帮你改好了，不过检查一下总不会错：

$ grep "passenger" nginx.conf
passenger_root /home/samson/.rvm/gems/ruby-1.9.2-p180@rails3/gems/passenger-3.0.5;
passenger_ruby /home/samson/.rvm/wrappers/ruby-1.9.2-p180@rails3/ruby;

配置一下，来跑一下之前创建的demo project：

server {¬
listen 80;¬
server_name demo.local;¬
root /home/samson/code/demo/public;¬
passenger_enabled on;¬
rails_env development;¬
}¬

$ sudo /opt/nginx/sbin/nginx

我取的server name时demo.local，所以在hosts里面加上这条entry后，我们就可以用browser访问 http://demo.local 了.

如果遇到403 forbidden，在nginx.conf里面改下user即可：

user samson users;

reload, welcome aboard!

$ sudo /opt/nginx/sbin/nginx -s reload

[Footnotes]

我有一个arch的liveusb，各种机子上一直保存着至少2+个arch的vm，虽然后来由于太占空间被转移到了移动硬盘，可就是一直舍不得删
最近老是official, official的… 你懂的

stdout customization

Samson Wu — Mon, 07 Mar 2011 10:16:15 +0000

前面介绍完了deployment，接下来该轮到customization了，这个也同样重要。我目前所能想到的需要customize的地方主要有5个地方，都集中在两个文件，并没有想象中的复杂，且听我一一道来：

[page title]

Location: RAILS_ROOT/app/views/layouts/application.html.erb, line 6

<title>$ cat /dev/stdin >> /dev/stdout | tee stdout.samsonw.infotitle>

change to whatever text you want.

[header title，sub-title]

Location: RAILS_ROOT/app/views/activities/index.html.erb, line 2, 3

<div id="title" class="grid_24">$ cat /dev/stdin >> /dev/stdout | tee stdout.samsonw.infodiv>
<div id="sub_title" class="grid_24">Don't Panic: fatal system error, core dump file not generated ...

change to whatever text you want.

[footer]

Location: RAILS_ROOT/app/views/activities/index.html.erb, line 23~27

<div id="copyright" class="grid_21">
<p>卢瑟出品，必属废品™  Copyright © 2010–2011 by <span class="losers">"Losers"span> Corporation.  All Rights Already <span class="losers">Lostspan>.p>
div>
<div class="grid_3">
<div id="curation">Curated by <a id="avatar" href="http://blog.samsonis.me/" target="_blank"><img src="/images/avatar.jpg" alt="Avatar" title="Samson Wu">a>div>
div>

change to whatever text you want.

[Disqus]
到Disqus register site和profile，然后拿到universal的javascript code，替换我的javascript code，具体位置在：

Location: RAILS_ROOT/app/views/layouts/application.html.erb, line 27~42

[Google Analytics]
同Disqus类似，到Google Analytics注册添加site，然后获得javascript code，替换默认的javascript code，位置在：

Location: RAILS_ROOT/app/views/layouts/application.html.erb, line 12~22

Enjoy and have fun!

stdout deployment

Samson Wu — Mon, 07 Mar 2011 08:11:33 +0000

首先值得一提的是为了支持HostMonster的fastcgi，我人为copy了几个以raild -D生成的项目结构里面的dispatch文件以及create了一个.htaccess文件，如果你不用fastcgi（通常情况下你不需要，而且也不推荐），你可以简单的删除它们（以下RAILS_ROOT是指rails app的根目录）：

RAILS_ROOT/config.ru
RAILS_ROOT/public/dispatch.cgi
RAILS_ROOT/public/dispatch.fcgi
RAILS_ROOT/public/dispatch.rb
RAILS_ROOT/public/.htaccess

[Development Environment]
Assume你的os已经装好ruby，如果没有请自行google，这里不再赘述。

首先update一下rubygems，最近rubygems貌似打了鸡血，更新极其频繁… 且bug具多…如果出了问题建议rollback到1.4.2…
[Note: 由于我使用rvm，所以以下command都没有sudo，根据你的情况你可能需要加上sudo]

$ gem update --system

从github上checkout一份最新的code，rails 2.3.11已经freeze进了source code，所以安装rails并不是必须的：

$ git clone git://github.com/samsonw/stdout.git
$ cd stdout

复制一份database.yml，不需要什么特别的修改，默认的dev环境配置是使用sqlite3的database：

$ cp config/database.yml.example config/database.yml

运行rake db:migrate之前确保已经装好了sqlite3-ruby gem和parse_feeds.rake所依赖的gem，不然rake可能会报错:

$ gem install sqlite3-ruby
$ gem install base64 json rest-client twitter nokogiri open-uri
$ rake db:migrate

如果没有报错，database应该已经建好，接下来我们需要给database populate some data，首先来搞Source表，编辑RAILS_ROOT/db/seeds.rb文件，修改blog的link或者删除某些不需要的link，也可以加上你需要的source，我默认加了4个source：

Source.find_or_create_by_name :name=>"blog", :display_name=>"Weblog", :url=>"http://blog.samsonis.me/"
Source.find_or_create_by_name :name=>"twitter", :display_name=>"Twitter", :url=>"http://twitter.com/"
Source.find_or_create_by_name :name=>"sina", :display_name=>"新浪微博", :url=>"http://t.sina.com.cn/"
Source.find_or_create_by_name :name=>"douban", :display_name=>"豆瓣", :url=>"http://www.douban.com/"

完成后我们就可以populate database：

$ rake db:seed

接下来来搞Activity表，这个表是需要实时更新的（我在production上是半小时一次），数据的更新是通过RAILS_ROOT/lib/tasks/parse_feeds.rake脚本完成的，根据你的需要你需要修改一下这个文件，比如blog的feed地址，sina的username/password，douban的miniblogs feed地址以及twitter的帐号（请自行注意翻墙），根据需要也可以删除或添加新的rake tasks，完成修改后，务必做下测试，我用一个vitual task stdout以简化运行（也为了之后方便cron job配置）：

$ rake stdout

如果需要，你也可以执行单个task：

$ rake feeds:parse
$ rake twitter:parse
$ rake sina:parse
$ rake douban:parse

如果一切正常，database应该已经populate完成，大功告成，server start，http://localhost:3000/, welcome abroad：

$ script/server

[Production Environment]
完成了开发环境的搭建，Production的deployment就会简单很多（当然用fastcgi的不算），因为本质上是差不多的，区别可能只在database和web server的配置之上（我们是卢瑟，没有多少点击率的小site根本不需要load balance，不需要cdn，不需要nosql，不需要distributed）.

database的配置请修改database.yml的production section，比如我们要用mysql database（最新driver是mysql2，不过as you may already know，HostMonser支持只支持mysql，你可以根据你的需要使用mysql2）：

$ gem install mysql

production:
adapter: mysql
encoding: utf8
database: MYSQL_DATABASE_NAME
pool: 5
username: MYSQL_USER
password: PASSWORD
host: localhost

web/app server建议使用passenger，然后apache抑或nginx，这里不再赘述；当然你也可以直接mongrel或是webrick抑或fastcgi.

最后你还需要配置一个cron job，定时更新数据，我在Production上每30分钟更新一次，你可以根据你的需要配置，比如某些话捞可能需要15分钟一次甚至5分钟一次：

15,45 * * * * cd RAILS_ROOT && rake RAILS_ENV="production" stdout >/dev/null 2>&1

能回忆记起的大致就这些了，如果deploy中有问题请留言，I’m more than happy to assist.

stdout on github

Samson Wu — Mon, 07 Mar 2011 05:23:57 +0000

stdout, aka LoserLogs or LoserStream is finally on github, check out at https://github.com/samsonw/stdout .

The code is based on rails 2.3.11 instead of rails 3, quite a surprise, isn’t it? Actually I was planning to, but after some research, it turns out my shared host provider HostMonster only support rails 2 at the time of this writing, shame on them.

It was always quite enjoyable to figure this and that out in the process of curating that site, except the deployment experiences on HostMonster. To my surprise, they’re still using Fastcgi to support rails application, again, shame on them.

Last but not least, the project is called “LoserLogs” and copyrighted by “Losers” corporation, cause I and along with some of my friends are all having the “loser” faith in our heart, this is NOT a joke :)

RubyGems 1.5.2 Manual Upgrade

Samson Wu — Wed, 16 Feb 2011 07:02:04 +0000

今天想更新RubyGems，突然发现 gem update ––system 貌似不work了：

$ gem -v
1.5.0

$ gem update --system
Updating RubyGems
ERROR: While executing gem ... (NoMethodError)
undefined method `version' for nil:NilClass

turns out 这是 RubyGems 1.5.0 和 1.5.1 的一个bug，1.5.2 fix了这个issue。

Manual的Upgrade可以绕过 reinstall 的麻烦和繁琐，且更低碳环保：

$ gem install rubygems-update
Fetching: rubygems-update-1.5.2.gem (100%)
Successfully installed rubygems-update-1.5.2
1 gem installed

$ update_rubygems
RubyGems 1.5.2 installed

=== 1.5.2 / 2011-02-10

NOTE: RubyGems 1.5.0 and 1.5.1 have a broken <tt>gem update --systemtt>.

To upgrade you'll need to use the manual upgrade recipe. Using sudo/su as
appropriate:

$ gem install rubygems-update
$ update_rubygems

Bug Fixes:

* Fixed gem update --system. RubyGems can now update itself again.

---------------------------------------------------------------------------

RubyGems installed the following executables:
/Users/samson/.rvm/rubies/ruby-1.9.2-p136/bin/gem

gem list

Samson Wu — Thu, 02 Sep 2010 15:50:37 +0000

响应蛋疼之号召，gem list一下，不过估计有点outdated，因为本人最近好几个月没碰ruby了，不过anyway，show了再说：

$ gem list --local | wc -l
147

为了有点视觉效果，特地把vertical scrollbar给干掉了，xd：

$ gem list --local

*** LOCAL GEMS ***

actionmailer (2.3.5, 2.3.4, 2.3.3, 2.3.2)
actionpack (2.3.5, 2.3.4, 2.3.3, 2.3.2)
activemerchant (1.5.1)
activerecord (2.3.5, 2.3.4, 2.3.3, 2.3.2)
activerecord-tableless (0.1.0)
activeresource (2.3.5, 2.3.4, 2.3.3, 2.3.2)
activesupport (2.3.5, 2.3.4, 2.3.3, 2.3.2)
authlogic (2.1.3)
authlogic-oid (1.0.4)
autotest (4.2.9)
autotest-fsevent (0.2.2, 0.1.1)
autotest-growl (0.2.3, 0.1.6)
autotest-rails (4.1.0)
autotest-rails-pure (4.1.0)
awesome_print (0.1.4, 0.1.2)
billing (0.1.0)
builder (2.1.2)
bundler (0.9.17, 0.9.16, 0.9.5)
cache-money (0.2.5)
calendar_date_select (1.16.1, 1.15)
cgi_multipart_eof_fix (2.5.0)
cheat (1.2.1)
chronic (0.2.3)
collectiveidea-awesome_nested_set (1.4.2)
columnize (0.3.1)
commondream-control_center (1.0.0)
configuration (1.1.0, 0.0.5)
crack (0.1.7, 0.1.4)
cucumber (0.6.4, 0.6.2, 0.3.104)
curb (0.7.1)
daemons (1.0.10)
dependencies (0.0.9, 0.0.6)
diff-lcs (1.1.2)
echoe (4.3, 3.2)
eventmachine (0.12.10, 0.12.8)
faker (0.3.1)
fastthread (1.0.7)
flay (1.4.0)
flog (2.4.0, 2.2.0)
gem_plugin (0.2.3)
gemcutter (0.5.0, 0.4.1)
geoip (0.8.6)
ghost (0.2.7, 0.2.3)
git (1.2.5)
gruff (0.3.6)
haml (2.2.22, 2.2.20, 2.2.2)
happymapper (0.3.0)
highline (1.5.2, 1.5.1)
hirb (0.3.1, 0.2.5)
hoe (2.6.0, 2.3.3)
hpricot (0.8.2, 0.8.1)
httpclient (2.1.5.2)
javan-whenever (0.3.7)
jeweler (1.4.0)
jnunemaker-validatable (1.8.3)
jscruggs-metric_fu (1.1.5)
json (1.2.3, 1.2.0, 1.1.9)
json_pure (1.2.3, 1.2.2)
laserlemon-vestal_versions (0.8.0, 0.6.0)
launchy (0.3.5, 0.3.3)
less (1.2.21, 1.2.20)
libxml-ruby (1.1.3)
linecache (0.43)
little-plugger (1.1.2, 1.1.1)
log4r (1.1.7, 1.1.2)
logging (1.4.1, 1.3.0)
looksee (0.2.1)
magic_multi_connections (1.2.1)
memcache-client (1.8.2, 1.8.0)
memcached (0.19.3)
mime-types (1.16)
mislav-will_paginate (2.3.11)
mocha (0.9.8, 0.9.7)
mojombo-chronic (0.3.0)
mongo (0.20, 0.19.3, 0.19.1)
mongo_ext (0.19.3, 0.19.1)
mongo_mapper (0.7.3, 0.7.1)
mongrel (1.1.5)
mozy_api (0.1.42)
mutter (0.5.3)
mysql (2.8.1)
nokogiri (1.4.1, 1.3.3)
paperclip (2.3.1.1)
passenger (2.2.11)
polyglot (0.3.1, 0.3.0)
postgres (0.7.9.2008.01.28)
production_log_analyzer (1.5.1)
rack (1.1.0, 1.0.1, 1.0.0)
rack-bug (0.2.1)
rack-test (0.5.3)
radiant (0.8.1)
rails (2.3.5, 2.3.4, 2.3.3, 2.3.2)
rails-footnotes (3.6.6)
rails_analyzer_tools (1.4.0)
rake (0.8.7)
rava (1.0.0)
rb-appscript (0.5.3)
rcov (0.9.8, 0.8.1.2.0)
RedCloth (4.2.3, 4.2.2)
redgreen (1.2.2)
reek (1.2.7.3, 1.2.1)
relevance-rcov (0.9.2.1)
request-log-analyzer (1.6.4)
rest-client (1.4.2, 1.0.3)
rmagick (2.13.1, 2.12.2)
roodi (2.1.0, 2.0.0)
rr (0.10.11, 0.10.10)
rspec (1.3.0, 1.2.8)
rspec-rails (1.3.2, 1.2.7.1)
ruby-debug (0.10.3)
ruby-debug-base (0.10.3)
ruby-debug-ide (0.4.9, 0.4.5)
ruby-hmac (0.4.0, 0.3.2)
ruby2ruby (1.2.4)
ruby_parser (2.0.4)
rubyforge (2.0.4, 1.0.4)
rubygems-update (1.3.7, 1.3.6, 1.3.5)
savon (0.7.6, 0.6.7)
searchlogic (2.4.14, 2.3.5)
sexp_processor (3.0.4, 3.0.3)
shotgun (0.6, 0.4)
sinatra (1.0, 0.9.4)
sketches (0.1.1)
soap4r (1.5.8)
spree (0.10.2, 0.8.5)
sqlite3-ruby (1.2.5)
state_machine (0.8.1, 0.8.0)
stringex (1.1.0, 1.0.3)
sys-uname (0.8.4, 0.8.3)
SyslogLogger (1.4.0)
system_timer (1.0)
term-ansicolor (1.0.5, 1.0.4)
thin (1.2.7, 1.2.5, 1.2.2)
thor (0.13.4, 0.11.5)
thoughtbot-shoulda (2.10.2)
tlsmail (0.0.1)
treetop (1.4.5, 1.4.4)
unicode (0.3.1)
validatable (1.6.7)
visionmedia-terminal-table (1.2.0)
webrat (0.7.0, 0.5.3)
whenever (0.4.1, 0.3.7)
will_paginate (2.3.12, 2.3.11)
wirble (0.1.3)
xml-simple (1.0.12)
ZenTest (4.3.1, 4.2.1)
zentest-without-autotest (4.2.1)

Ruby gem geoip and Rack::GeoIPCountry

Samson Wu — Thu, 25 Feb 2010 08:51:44 +0000

wikipedia上对于geolocation的解释是这样的：

Geolocation is the identification of the real-world geographic location of an Internet-connected computer, mobile device, website visitor or other.

检测的方法貌似也有很多：

Geolocation can be performed by associating a geographic location with the Internet Protocol (IP) address, MAC address, RFID, hardware embedded article/production number, embedded software number (such as UUID, Exif/IPTC/XMP or modern steganography), invoice, Wi-Fi connection location, or device GPS coordinates, or other, perhaps self-disclosed information.

（班门弄斧一下先，呵呵呵呵）

ruby里面取到geo信息的一个相对方便的办法是使用rubygem geoip，虽然本质上还是使用maxmind的data，但是免去了编译和安装其c library的麻烦。

安装gem并下载其depend到的geoip database：

$ sudo gem install geoip

$ wget http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz && gunzip GeoIP.dat.gz

如果想要城市信息，还可以下载稍微大一点的带city info的free database：

$ wget http://geolite.maxmind.com/download/geoip/database/GeoLiteCity.dat.gz && gunzip GeoLiteCity.dat.gz

简单的测试一下：

require 'rubygems'
require 'geoip'

p GeoIP.new('GeoIP.dat').country("google.com")
p GeoIP.new('GeoLiteCity.dat').city("baidu.com")

alright, looks good:

["google.com", "66.249.91.104", 225, "US", "USA", "United States", "NA"]
["baidu.com", "220.181.6.81", "CN", "CHN", "China", "AS", "22", "Beijing", "", 39.9289, 116.3883]

由于geo的普遍性，把其做成可以plug&play的Rack middleware绝对是个好主意，这就是接下来要介绍的Rack::GeoIPCountry，CodeRack Contest的first place。

其原理就是调用geoip gem获得访问IP的geo信息并写入request header，这样后面的app或者middleware就能读到并处理了。

同样写个简单的middleware测试一下：

require 'geo_ip_country'

class GeoTest
def initialize(app)
@app = app
end

def call(env)
puts "Remote Address: #{env['REMOTE_ADDR']}"
puts "GeoIP Country ID: #{env['X_GEOIP_COUNTRY_ID']}"
puts "GeoIP Country Code: #{env['X_GEOIP_COUNTRY_CODE']}"
puts "GeoIP Country Code3: #{env['X_GEOIP_COUNTRY_CODE3']}"
puts "GeoIP Country: #{env['X_GEOIP_COUNTRY']}"
puts "GeoIP Continent: #{env['X_GEOIP_CONTINENT']}"
@app.call(env)
end
end

use Rack::ContentLength
use Rack::GeoIPCountry
use GeoTest

run Proc.new { |env| [200, { 'Content-Type' => 'text/html' }, 'OK'] }

rackup起来后，访问http://localhost:9292，确认console下输出了我们想要的geo信息：

Remote Address: 127.0.0.1
GeoIP Country ID: 0
GeoIP Country Code: --
GeoIP Country Code3: --
GeoIP Country: N/A
GeoIP Continent: --
127.0.0.1 - - [25/Feb/2010 16:36:11] "GET / HTTP/1.1" 200 2 0.0016

当然上面的127.0.0.1是不会有任何信息的，local network也是不会在database里面找到对应的，只有当真正的外网ip hit到我们的server时，我们才能看到有意义的geo信息。

List performance: ruby 1.8 and 1.9 (Part 2)

Samson Wu — Mon, 22 Feb 2010 05:54:36 +0000

接上篇： List performance: ruby 1.8 and 1.9 (Part 1)

有了之前的准备和热身，真正跑起步来似乎轻松不少，先贴上我们用来benchmark的code：

require 'benchmark'

n = ARGV.empty? ? 10 ** 6 : 10 ** ARGV[0].to_i
puts "n=#{n}"
Benchmark.bmbm do |x|
x.report do
list = []
n.times do
list << 0
end
end
end

和之前用来benchmark loop performance的code结构上基本没有区别，这里不再赘述，具体的解释亦可参照前文。

下面分别是ruby 1.8和ruby 1.9的一次完整运行（ n=10~10^8 ）的数据结果（也是我唯一运行的一次…）

ruby 1.8:

n=10
Rehearsal ------------------------------------
0.000000 0.000000 0.000000 ( 0.000014)
--------------------------- total: 0.000000sec

user system total real
0.000000 0.000000 0.000000 ( 0.000012)
==============================================

n=100
Rehearsal ------------------------------------
0.000000 0.000000 0.000000 ( 0.000118)
--------------------------- total: 0.000000sec

user system total real
0.000000 0.000000 0.000000 ( 0.000061)
==============================================

n=1000
Rehearsal ------------------------------------
0.000000 0.000000 0.000000 ( 0.000375)
--------------------------- total: 0.000000sec

user system total real
0.000000 0.000000 0.000000 ( 0.000314)
==============================================

n=10000
Rehearsal ------------------------------------
0.000000 0.000000 0.000000 ( 0.002900)
--------------------------- total: 0.000000sec

user system total real
0.010000 0.000000 0.010000 ( 0.002790)
==============================================

n=100000
Rehearsal ------------------------------------
0.030000 0.000000 0.030000 ( 0.027712)
--------------------------- total: 0.030000sec

user system total real
0.020000 0.000000 0.020000 ( 0.027713)
==============================================

n=1000000
Rehearsal ------------------------------------
0.280000 0.010000 0.290000 ( 0.323298)
--------------------------- total: 0.290000sec

user system total real
0.280000 0.010000 0.290000 ( 0.283621)
==============================================

n=10000000
Rehearsal ------------------------------------
2.740000 0.050000 2.790000 ( 2.809917)
--------------------------- total: 2.790000sec

user system total real
2.760000 0.040000 2.800000 ( 2.810491)
==============================================

n=100000000
Rehearsal ------------------------------------
27.410000 0.490000 27.900000 ( 28.164103)
-------------------------- total: 27.900000sec

user system total real
27.620000 0.480000 28.100000 ( 28.230073)
==============================================

ruby 1.9:

n=10
Rehearsal ------------------------------------
0.000000 0.000000 0.000000 ( 0.000068)
--------------------------- total: 0.000000sec

user system total real
0.000000 0.000000 0.000000 ( 0.000012)
==============================================

n=100
Rehearsal ------------------------------------
0.000000 0.000000 0.000000 ( 0.000038)
--------------------------- total: 0.000000sec

user system total real
0.000000 0.000000 0.000000 ( 0.000032)
==============================================

n=1000
Rehearsal ------------------------------------
0.000000 0.000000 0.000000 ( 0.000297)
--------------------------- total: 0.000000sec

user system total real
0.000000 0.000000 0.000000 ( 0.000209)
==============================================

n=10000
Rehearsal ------------------------------------
0.000000 0.000000 0.000000 ( 0.002164)
--------------------------- total: 0.000000sec

user system total real
0.000000 0.000000 0.000000 ( 0.002025)
==============================================

n=100000
Rehearsal ------------------------------------
0.020000 0.000000 0.020000 ( 0.020366)
--------------------------- total: 0.020000sec

user system total real
0.020000 0.000000 0.020000 ( 0.020873)
==============================================

n=1000000
Rehearsal ------------------------------------
0.190000 0.010000 0.200000 ( 0.208302)
--------------------------- total: 0.200000sec

user system total real
0.190000 0.000000 0.190000 ( 0.208822)
==============================================

n=10000000
Rehearsal ------------------------------------
1.920000 0.050000 1.970000 ( 2.050276)
--------------------------- total: 1.970000sec

user system total real
1.920000 0.050000 1.970000 ( 2.054335)
==============================================

n=100000000
Rehearsal ------------------------------------
19.220000 0.460000 19.680000 ( 20.466960)
-------------------------- total: 19.680000sec

user system total real
19.220000 0.460000 19.680000 ( 20.546417)
==============================================

就这次运行的结果而言，ruby 1.9的performance平均都有25%～35%的提升，加之Part 1测试过的循环性能的倒退，则更可以确定list append操作的performance确实在1.9里面较1.8有了很大的提高。

List performance: ruby 1.8 and 1.9 (Part 1)

Samson Wu — Mon, 22 Feb 2010 02:47:02 +0000

（本文数据较多，在rss reader里面可能可读性不是很好，可考虑直接在线阅读）

昨天看到pipitu的这篇blog，觉得蛮有意思，文章比较了python和java的list performance，只可惜没有include ruby 1.8和ruby 1.9，不然结论会更有悬念一点，呵呵.

由于无法营造一致的软硬件环境，也不愿意重复pipitu关于python和java部分的工作，这里就只好先简单benchmark（如果可以算是的话）一下ruby 1.8和1.9里的list (array) performance了，也许pipitu以后有空更新include ruby也说不定：）

先看一下我们用的ruby的版本：

$ ruby -v
ruby 1.8.7 (2009-06-12 patchlevel 174) [i686-darwin9]

$ ruby1.9 -v
ruby 1.9.1p376 (2009-12-07 revision 26041) [i386-darwin9]

还有os：

$ uname -a
Darwin macbook.local 9.8.0 Darwin Kernel Version 9.8.0: Wed Jul 15 16:55:01 PDT 2009; root:xnu-1228.15.4~1/RELEASE_I386 i386

benchmark的方法和pipitu的python sample类似，就是往空的list里面循环n次append，由于循环也被引入，其performance也值得考虑，因为众所周知ruby里面做一件事犹如孔乙己的茴字写法一样有n种办法，其performance也各不一样，说不定pipitu以后会和python, java进行横向，咱还是挑相对快一点的好～不过话说回来，再怎么的精挑细选，java那边还是基本没有悬念，真正有悬念的，我们都心知肚明，呵呵。

所以真正运动之前先来点热身运动，看看哪个循环在我这相对要快：

require 'benchmark'

n = ARGV.empty? ? 10 ** 6 : 10 ** ARGV[0].to_i
puts "n=#{n}"
Benchmark.bmbm do |b|
b.report("for:") { for i in 1..n ; a = "0"; end }
b.report("times:") { n.times do ; a = "0"; end }
b.report("upto:") { 1.upto(n) do ; a = "0"; end }
b.report("downto:") { n.downto(1) do ; a = "0"; end }
end

以上是我所想到的比较常见的4种茴字写法，程序默认取n=10^6进行循环，也可以接受一个作为幂指数的命令行参数，Benchmark的bmbm方法会先dry run一遍所有test作为rehearsal，等memory和garbage collection的状态相对stable了以后才进行真正的benchmark，这样先运行和后运行的report会相对公平一点。

默认运行（ n=10^6 ）的结果如下：

n=1000000
Rehearsal -------------------------------------------
for: 0.310000 0.000000 0.310000 ( 0.313392)
times: 0.290000 0.000000 0.290000 ( 0.297268)
upto: 0.300000 0.000000 0.300000 ( 0.300311)
downto: 0.310000 0.000000 0.310000 ( 0.304146)
---------------------------------- total: 1.210000sec

user system total real
for: 0.310000 0.000000 0.310000 ( 0.313129)
times: 0.290000 0.000000 0.290000 ( 0.297470)
upto: 0.300000 0.000000 0.300000 ( 0.302154)
downto: 0.310000 0.000000 0.310000 ( 0.305562)

一次完整运行（ n=10~10^8 ）的数据结果如下：

n=10
Rehearsal -------------------------------------------
for: 0.000000 0.000000 0.000000 ( 0.000018)
times: 0.000000 0.000000 0.000000 ( 0.000011)
upto: 0.000000 0.000000 0.000000 ( 0.000047)
downto: 0.000000 0.000000 0.000000 ( 0.000053)
---------------------------------- total: 0.000000sec

user system total real
for: 0.000000 0.000000 0.000000 ( 0.000014)
times: 0.000000 0.000000 0.000000 ( 0.000011)
upto: 0.000000 0.000000 0.000000 ( 0.000011)
downto: 0.000000 0.000000 0.000000 ( 0.000011)
=====================================================

n=100
Rehearsal -------------------------------------------
for: 0.000000 0.000000 0.000000 ( 0.000041)
times: 0.000000 0.000000 0.000000 ( 0.000031)
upto: 0.000000 0.000000 0.000000 ( 0.000033)
downto: 0.000000 0.000000 0.000000 ( 0.000040)
---------------------------------- total: 0.000000sec

user system total real
for: 0.000000 0.000000 0.000000 ( 0.000035)
times: 0.000000 0.000000 0.000000 ( 0.000030)
upto: 0.000000 0.000000 0.000000 ( 0.000031)
downto: 0.000000 0.000000 0.000000 ( 0.000031)
=====================================================

n=1000
Rehearsal -------------------------------------------
for: 0.000000 0.000000 0.000000 ( 0.000367)
times: 0.000000 0.000000 0.000000 ( 0.000315)
upto: 0.000000 0.000000 0.000000 ( 0.000319)
downto: 0.000000 0.000000 0.000000 ( 0.000854)
---------------------------------- total: 0.000000sec

user system total real
for: 0.000000 0.000000 0.000000 ( 0.000273)
times: 0.000000 0.000000 0.000000 ( 0.000250)
upto: 0.000000 0.000000 0.000000 ( 0.000254)
downto: 0.000000 0.000000 0.000000 ( 0.000258)
=====================================================

n=10000
Rehearsal -------------------------------------------
for: 0.000000 0.000000 0.000000 ( 0.003388)
times: 0.010000 0.000000 0.010000 ( 0.003056)
upto: 0.000000 0.000000 0.000000 ( 0.003006)
downto: 0.000000 0.000000 0.000000 ( 0.003084)
---------------------------------- total: 0.010000sec

user system total real
for: 0.010000 0.000000 0.010000 ( 0.003114)
times: 0.000000 0.000000 0.000000 ( 0.002955)
upto: 0.000000 0.000000 0.000000 ( 0.003047)
downto: 0.010000 0.000000 0.010000 ( 0.004650)
=====================================================

n=100000
Rehearsal -------------------------------------------
for: 0.030000 0.000000 0.030000 ( 0.032892)
times: 0.030000 0.000000 0.030000 ( 0.029808)
upto: 0.030000 0.000000 0.030000 ( 0.031190)
downto: 0.030000 0.000000 0.030000 ( 0.030379)
---------------------------------- total: 0.120000sec

user system total real
for: 0.030000 0.000000 0.030000 ( 0.033382)
times: 0.030000 0.000000 0.030000 ( 0.029139)
upto: 0.030000 0.000000 0.030000 ( 0.031608)
downto: 0.030000 0.000000 0.030000 ( 0.030498)
=====================================================

n=1000000
Rehearsal -------------------------------------------
for: 0.310000 0.000000 0.310000 ( 0.313392)
times: 0.290000 0.000000 0.290000 ( 0.297268)
upto: 0.300000 0.000000 0.300000 ( 0.300311)
downto: 0.310000 0.000000 0.310000 ( 0.304146)
---------------------------------- total: 1.210000sec

user system total real
for: 0.310000 0.000000 0.310000 ( 0.313129)
times: 0.290000 0.000000 0.290000 ( 0.297470)
upto: 0.300000 0.000000 0.300000 ( 0.302154)
downto: 0.310000 0.000000 0.310000 ( 0.305562)
=====================================================

n=10000000
Rehearsal -------------------------------------------
for: 3.090000 0.000000 3.090000 ( 3.109693)
times: 2.940000 0.010000 2.950000 ( 2.946662)
upto: 2.990000 0.010000 3.000000 ( 3.003812)
downto: 3.010000 0.000000 3.010000 ( 3.021900)
--------------------------------- total: 12.050000sec

user system total real
for: 3.110000 0.010000 3.120000 ( 3.119928)
times: 2.950000 0.010000 2.960000 ( 2.992141)
upto: 3.000000 0.010000 3.010000 ( 3.044853)
downto: 3.020000 0.000000 3.020000 ( 3.036987)
=====================================================

n=100000000
Rehearsal -------------------------------------------
for: 30.950000 0.070000 31.020000 ( 31.139756)
times: 29.360000 0.060000 29.420000 ( 29.543839)
upto: 29.890000 0.070000 29.960000 ( 30.102346)
downto: 30.080000 0.070000 30.150000 ( 30.271642)
-------------------------------- total: 120.550000sec

user system total real
for: 31.130000 0.080000 31.210000 ( 31.359814)
times: 29.420000 0.050000 29.470000 ( 29.630556)
upto: 30.050000 0.060000 30.110000 ( 30.197589)
downto: 30.180000 0.050000 30.230000 ( 30.361343)
=====================================================

由于精力有限，就不做多次运行取平均值这种相对无聊的事情了，结果虽然不严谨也无法真正判断出究竟谁最快（times和upto，downto是在伯仲之间），但至少可以看出for in range是相对最慢的。

换ruby1.9后的运行结果与上基本一致，详细数据如下：

n=10
Rehearsal -------------------------------------------
for: 0.000000 0.000000 0.000000 ( 0.000029)
times: 0.000000 0.000000 0.000000 ( 0.000050)
upto: 0.000000 0.000000 0.000000 ( 0.000014)
downto: 0.000000 0.000000 0.000000 ( 0.000013)
---------------------------------- total: 0.000000sec

user system total real
for: 0.000000 0.000000 0.000000 ( 0.000014)
times: 0.000000 0.000000 0.000000 ( 0.000011)
upto: 0.000000 0.000000 0.000000 ( 0.000012)
downto: 0.000000 0.000000 0.000000 ( 0.000012)
=====================================================

n=100
Rehearsal -------------------------------------------
for: 0.000000 0.000000 0.000000 ( 0.000061)
times: 0.000000 0.000000 0.000000 ( 0.000103)
upto: 0.000000 0.000000 0.000000 ( 0.000078)
downto: 0.000000 0.000000 0.000000 ( 0.000060)
---------------------------------- total: 0.000000sec

user system total real
for: 0.000000 0.000000 0.000000 ( 0.000066)
times: 0.000000 0.000000 0.000000 ( 0.000061)
upto: 0.000000 0.000000 0.000000 ( 0.000061)
downto: 0.000000 0.000000 0.000000 ( 0.000061)
=====================================================

n=1000
Rehearsal -------------------------------------------
for: 0.000000 0.000000 0.000000 ( 0.000465)
times: 0.000000 0.000000 0.000000 ( 0.000461)
upto: 0.000000 0.000000 0.000000 ( 0.000477)
downto: 0.000000 0.000000 0.000000 ( 0.000428)
---------------------------------- total: 0.000000sec

user system total real
for: 0.000000 0.000000 0.000000 ( 0.000388)
times: 0.000000 0.000000 0.000000 ( 0.000339)
upto: 0.000000 0.000000 0.000000 ( 0.000341)
downto: 0.000000 0.000000 0.000000 ( 0.000339)
=====================================================

n=10000
Rehearsal -------------------------------------------
for: 0.000000 0.000000 0.000000 ( 0.004486)
times: 0.010000 0.000000 0.010000 ( 0.003675)
upto: 0.000000 0.000000 0.000000 ( 0.004407)
downto: 0.000000 0.000000 0.000000 ( 0.004121)
---------------------------------- total: 0.010000sec

user system total real
for: 0.010000 0.000000 0.010000 ( 0.003961)
times: 0.000000 0.000000 0.000000 ( 0.005113)
upto: 0.010000 0.000000 0.010000 ( 0.003592)
downto: 0.000000 0.000000 0.000000 ( 0.003592)
=====================================================

n=100000
Rehearsal -------------------------------------------
for: 0.040000 0.000000 0.040000 ( 0.042573)
times: 0.030000 0.000000 0.030000 ( 0.039094)
upto: 0.030000 0.000000 0.030000 ( 0.041495)
downto: 0.040000 0.000000 0.040000 ( 0.049316)
---------------------------------- total: 0.140000sec

user system total real
for: 0.040000 0.000000 0.040000 ( 0.040422)
times: 0.040000 0.000000 0.040000 ( 0.037030)
upto: 0.040000 0.000000 0.040000 ( 0.041921)
downto: 0.040000 0.000000 0.040000 ( 0.039868)
=====================================================

n=1000000
Rehearsal -------------------------------------------
for: 0.390000 0.000000 0.390000 ( 0.401887)
times: 0.370000 0.000000 0.370000 ( 0.376656)
upto: 0.370000 0.010000 0.380000 ( 0.384750)
downto: 0.370000 0.000000 0.370000 ( 0.380184)
---------------------------------- total: 1.510000sec

user system total real
for: 0.400000 0.000000 0.400000 ( 0.411929)
times: 0.370000 0.000000 0.370000 ( 0.386443)
upto: 0.370000 0.010000 0.380000 ( 0.379820)
downto: 0.370000 0.000000 0.370000 ( 0.379068)
=====================================================

n=10000000
Rehearsal -------------------------------------------
for: 3.920000 0.020000 3.940000 ( 4.021434)
times: 3.690000 0.030000 3.720000 ( 3.844118)
upto: 3.710000 0.030000 3.740000 ( 3.844035)
downto: 3.700000 0.020000 3.720000 ( 3.795330)
--------------------------------- total: 15.120000sec

user system total real
for: 3.910000 0.020000 3.930000 ( 4.003016)
times: 3.670000 0.020000 3.690000 ( 3.749495)
upto: 3.700000 0.020000 3.720000 ( 3.919785)
downto: 3.690000 0.030000 3.720000 ( 3.789975)
=====================================================

n=100000000
Rehearsal -------------------------------------------
for: 39.260000 0.240000 39.500000 ( 40.293460)
times: 36.700000 0.210000 36.910000 ( 37.450910)
upto: 37.020000 0.260000 37.280000 ( 38.963391)
downto: 36.940000 0.230000 37.170000 ( 37.806189)
-------------------------------- total: 150.860000sec

user system total real
for: 39.230000 0.240000 39.470000 ( 40.471694)
times: 36.850000 0.240000 37.090000 ( 38.302817)
upto: 36.870000 0.230000 37.100000 ( 37.802815)
downto: 36.970000 0.220000 37.190000 ( 38.052300)
=====================================================

有趣的是ruby1.9的循环操作性能竟然普遍都是负增长，这倒为我们之后的list performance比较埋下了伏笔。

热身运动到此结束，似乎有喧宾夺主之嫌，所以赶紧搞个part 2…，下篇文章我们会用上面循环性能测试的疑似最佳表现者times来进行list append性能测试，敬请期待。

Samson's Weblog » Ruby

Downgrade Rubygems

Related posts

ArchLinux, RVM, Ruby, Rails, Nginx, Passenger and You

Related posts

stdout customization

Related posts

stdout deployment

Related posts

stdout on github

Related posts

RubyGems 1.5.2 Manual Upgrade

Related posts

gem list

Related posts

Ruby gem geoip and Rack::GeoIPCountry

Related posts

List performance: ruby 1.8 and 1.9 (Part 2)

Related posts

List performance: ruby 1.8 and 1.9 (Part 1)

Related posts