Programming Tools
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
User Name:
Password:
Remember me
 
Go Back   Dev Articles Community ForumsProgrammingProgramming Tools

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Display Modes
 
Unread Dev Articles Community Forums Sponsor:
  #1  
Old May 9th, 2003, 09:17 AM
AndreTheGiant AndreTheGiant is offline
Junior Member
Dev Articles Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 1 AndreTheGiant User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
Perl Question - make sure array has unique strings only

I need to build a list (array) of urls in string form. Im going to incrementally add urls to the list as i crawl the web and find new urls to add. My question is how can i ensure that each time I am aobut to add a new url to the list, that it is not already in the list?

The only way i can think of, is to loop through the list before each add to make sure the newly found url is not already in there, but this must be really inefficient, especially since i expect my list to grow to 10000 in size or perhaps more.


Is there a better way to keep track of the urls ive alreay visited and avoid visiting them again?

Reply With Quote
  #2  
Old May 9th, 2003, 09:23 PM
Ben Rowe
Guest
Dev Articles Newbie (0 - 499 posts)
 
Posts: n/a  
Time spent in forums:
Reputation Power:
i don't actually know perl, but do you know if perl has an inarray function of some type? something where you can compair a string to all elements of an array.

thats basically what you need to do

Reply With Quote
Reply

Viewing: Dev Articles Community ForumsProgrammingProgramming Tools > Perl Question - make sure array has unique strings only


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 1 hosted by Hostway
Stay green...Green IT