SEOClerks

Custom program to extract email address from craiglist.org

Custom program to extract email address from craiglist.org

I need a custom web scraper to extract email address from Craiglist based on my selected keywords.
The Program must be guaranteed to work for at least six 8 months

Please read the entire requirement before bidding. Please bid only if you know how to do this. For someone who knows, it wont be a big job


Requirements

I Need a program to do the following:

1. Automatically extract email address from any City or State in US

2. I will set up my own keywords and it will only extract email addresses from ads that contains the keywords

3. Search postings and scrape email address from any City and Category combination within US

4. skip @xxxxxxxxxx.org email addresses, and Extract other Emails

5. It must scrape email addresses directly from Ad Content

6. It must export the email addresses to CSV or Excel formats

7. It must remove duplicate addresses

This Program must be guaranteed to work for at least six 8 months


Skills Required

Webscraping Excel Customprogram Programming

Bids

this is correctly what you need to collect mail , this is 2 best of email scrape tools

Bid On Listing Created 12 years ago in Programming

Other jobs by ayanbishnu

Order Now
Process Time: 0.17835688591003

Possible Duplicate queries found!
MatchCountSQLScript
SELECT * FROM wanttobuy A, categories_wanttobuy B, seoclerks.members C WHERE A.wantid='18648' AND A.category=B.CATID AND A.USERID=C.USERID1SELECT A.*, B.name, B.seo, C.username, C.userlevel, C.footer_code, C.rating, C.ratingcount, C.googleplus_profile, C.total_recommendations, C.USERID, C.profilepicture, C.average_response_time, C.lastlogin, C.addtime FROM wanttobuy A, categories_wanttobuy B, seoclerks.members C WHERE A.wantid='18648' AND A.category=B.CATID AND A.USERID=C.USERID

/opt/clerks-staging/docroot/viewwant.php 163 () ()

SELECT * FROM ratings_buyer WHERE USERID=1720531SELECT sum(good) as thumbup, sum(bad) as thumbdown FROM ratings_buyer WHERE USERID=172053

/opt/clerks-staging/docroot/include/functions/main.php 19523 GetRatingsAsBuyerTotal() ()

SELECT * FROM wanttobuy A, categories_wanttobuy B WHERE A.wantid != 18648 AND A.category=B.CATID AND A.active=1 AND (A.tags like '%Webscraping Excel Customprogram Programming%' ) LIMIT 41SELECT A.wantid, A.title, A.p1, A.maxprice, B.name, B.seo FROM wanttobuy A, categories_wanttobuy B WHERE A.wantid != 18648 AND A.category=B.CATID AND A.active=1 AND (A.tags like '%Webscraping Excel Customprogram Programming%' ) LIMIT 4

/opt/clerks-staging/docroot/viewwant.php 551 () ()

SELECT * FROM wanttobuy A, categories_wanttobuy B WHERE A.wantid != 18648 AND A.category=B.CATID AND A.active=1 AND A.USERID=172053 LIMIT 41SELECT A.wantid, A.title, A.p1, A.maxprice, B.name, B.seo FROM wanttobuy A, categories_wanttobuy B WHERE A.wantid != 18648 AND A.category=B.CATID AND A.active=1 AND A.USERID=172053 LIMIT 4

/opt/clerks-staging/docroot/viewwant.php 568 () ()

SELECT * FROM wantcomments a, seoclerks.members b WHERE a.PID='18648' AND a.USERID=b.USERID and b.status='1' AND a.status=1 order by a.CID asc1SELECT a.comment, a.USERID, a.CID, a.time_added, a.istranslated, a.parentid, b.username, b.profilepicture FROM wantcomments a, seoclerks.members b WHERE a.PID='18648' AND a.USERID=b.USERID and b.status='1' AND a.status=1 order by a.CID asc

/opt/clerks-staging/docroot/viewwant.php 835 () ()

UPDATE wanttobuy SET viewcount = viewcount + 1 WHERE wantid='18648'1UPDATE wanttobuy SET viewcount = viewcount + 1 WHERE wantid='18648'

/opt/clerks-staging/docroot/include/functions/main.php 1729 update_wantviewcount() ()

SELECT * FROM wantbids as w, seoclerks.members AS m WHERE w.active=1 AND m.USERID=w.USERID AND m.status=1 AND w.USERID>0 AND w.wantid='18648' ORDER BY w.bidid ASC 1SELECT w.bidid, w.PID, w.comment, w.title, w.pricepublic, w.USERID, w.adjustedprice, w.ip, m.profilepicture FROM wantbids as w, seoclerks.members AS m WHERE w.active=1 AND m.USERID=w.USERID AND m.status=1 AND w.USERID>0 AND w.wantid='18648' ORDER BY w.bidid ASC

/opt/clerks-staging/docroot/viewwant.php 1192 () ()

SELECT * FROM seoclerks.members as m WHERE m.USERID=1697791SELECT m.username, m.skills, m.userlevel, m.ip, m.total_recommendations FROM seoclerks.members as m WHERE m.USERID=169779

/opt/clerks-staging/docroot/viewwant.php 1258 () ()

SELECT * FROM categories_wanttobuy1SELECT * FROM categories_wanttobuy

/opt/clerks-staging/docroot/libraries/adodb5/adodb.inc.php 1899 CacheExecute() parseRedundantQueriesCache()

SELECT * FROM posts WHERE USERID=1720531SELECT sum(positive_ratings) as thumbup, sum(negative_ratings) as thumbdown FROM posts WHERE USERID=172053

/opt/clerks-staging/docroot/libraries/adodb5/adodb.inc.php 1899 CacheExecute() GetBuyerRatingsTotal()

SELECT * FROM categories1SELECT * FROM categories

/opt/clerks-staging/docroot/libraries/adodb5/adodb.inc.php 1899 CacheExecute() parseRedundantQueriesCache()

select * from categories_software order by name asc1select * from categories_software order by name asc

/opt/clerks-staging/docroot/libraries/adodb5/adodb.inc.php 1899 CacheExecute() insert_GetSoftwareCategories()

select * from categories_wanttobuy order by name asc1select * from categories_wanttobuy order by name asc

/opt/clerks-staging/docroot/libraries/adodb5/adodb.inc.php 1899 CacheExecute() insert_get_wantcategories()

select * from categories_wanttotrade order by name asc1select * from categories_wanttotrade order by name asc

/opt/clerks-staging/docroot/libraries/adodb5/adodb.inc.php 1899 CacheExecute() insert_get_tradecategories()

SELECT * FROM seoclerks.members WHERE USERID='169779'1SELECT profilepicture FROM seoclerks.members WHERE USERID='169779'

/opt/clerks-staging/docroot/libraries/adodb5/adodb.inc.php 1899 CacheExecute() getUserProfileImage()

SELECT * FROM seoclerks.members WHERE USERID='172053'1SELECT profile_data FROM seoclerks.members WHERE USERID='172053'

/opt/clerks-staging/docroot/include/functions/main.php 1927 getUserBackground() include()

Invalid SQL

count(*)sql1error_msg

Expensive SQL

Tuning the following SQL could reduce the server load substantially
LoadCountSQLMaxMin

Suspicious SQL

The following SQL have high average execution times
Avg TimeCountSQLMaxMin
0.4210301SELECT A.*, C.username, C.profilepicture, C.userlevel, C.ratingcount, C.rating, C.lastlogin, C.ip, C.lip, C.profile_data from posts A, seoclerks.members C WHERE A.active=1 AND A.USERID=C.USERID AND A.sold_out=0 AND category IN (100) AND gtags like'%Emails%' AND type !=99 AND A.feat=0 AND A.catfeatured_upgrade=0 order by A.lastgigedit desc limit 0, 400.4210300.421030
0.2575791SELECT count(A.PID) as total from posts A , seoclerks.members C WHERE A.active=1 AND A.USERID=C.USERID AND A.sold_out=0 AND A.USERID=C.USERID AND category IN (100) AND gtags like'%Emails%' AND type !=99 0.2575790.257579
0.1202201SELECT A.wantid, A.title, A.p1, A.maxprice, B.name, B.seo FROM wanttobuy A, categories_wanttobuy B WHERE A.wantid != 18648 AND A.category=B.CATID AND A.active=1 AND (A.tags like '%Webscraping Excel Customprogram Programming%' ) LIMIT 40.1202200.120220