DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone >

Proxy List Fetcher Using Ruby

Khaled Alhabache user avatar by
Khaled Alhabache
·
Sep. 15, 09 · · Code Snippet
Like (0)
Save
Tweet
5.80K Views

Join the DZone community and get the full member experience.

Join For Free
Proxy list fetcher using Ruby, it saves proxies inside proxy_list.txt file


require 'rubygems'
require 'hpricot'
require 'open-uri'
require 'digest/sha1'

file = File.new("proxy_list.txt", "w")
doc = Hpricot(open("http://www.proxy4free.com/page1.html"))
trs = (doc/"table tr.text")
trs.each do |tr|
  ip = (tr/"td:nth(0)").first.inner_html
  if ip.match(/^[\d\.]+$/)
    port = (tr/"td:nth(1)").first.inner_html
    file.puts "#{ip}:#{port}"
  end
end
file.close

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • Deployment of Low-Latency Solutions in the Cloud
  • Growth in Java Development for Web and Mobile Apps
  • Java: Why Core-to-Core Latency Matters
  • How To Integrate Third-Party Login Systems in Your Web App Using OAuth 2.0

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo