fix scraper and recode to output to XML

Ditutup Disiarkan Feb 19, 2012 Dibayar semasa penghantaran
Ditutup Dibayar semasa penghantaran

I have the following scraper (password and login details given with NDA and project win)

INstead of outputting to MYSQL, I would like the data outputo to XML file.

The data, as you can see is scraped with a hierarchy (tree) format (MLM company) with parent/child relationships. This data is easily put into XML.

It also has auditing (simple separate file of ID number and data history).

So you have two choices, you can rewrite the code from scratch, which is probably a waste of time, as the scraper has been created, and output to XML. OR you can rewrite the code that writes to mysql and instead send it to XML (using SimpleXML or something (classes best for extensibility).

I have attached both the PHP file (password changed until accepted, happy to teamviewer the data with serious prospects) this will be finished within a week. and the previous sql file.

SQL file for data was - am happy to give you full files.

The PHP script above for some reason stops randomly, somewhere through the scrape (few thousand records in) ... not sure about this, but I think it is a problem putting the data in the MYSQL. in this case, please make sure ALL data is tested to it's type. before writing it.

CREATE TABLE `data` (
`id` int(10) unsigned NOT NULL AUTO_INCREMENT,
`level` varchar(45) DEFAULT NULL,
`name` varchar(100) DEFAULT NULL,
`icon_busassist` int(10) unsigned zerofill DEFAULT NULL,
`icon_event` int(10) unsigned zerofill DEFAULT NULL,
`icon_rolodex` int(10) unsigned zerofill DEFAULT NULL,
`icon_dl` int(10) unsigned zerofill DEFAULT NULL,
`icon_pie` int(10) unsigned zerofill DEFAULT NULL,
`icon_promo` int(10) unsigned zerofill DEFAULT NULL,
`icon_cd` int(10) unsigned zerofill DEFAULT NULL,
`icon_dws` int(10) unsigned zerofill DEFAULT NULL,
`icon_dlr` int(10) unsigned zerofill DEFAULT NULL,
`icon_viz` int(10) unsigned zerofill DEFAULT NULL,
`cart` int(10) unsigned zerofill DEFAULT NULL,
`country` varchar(45) DEFAULT NULL,
`location` varchar(45) DEFAULT NULL,
`teamID` varchar(45) DEFAULT NULL,
`position` varchar(45) DEFAULT NULL,
`startdate` datetime DEFAULT NULL,
`LD` int(10) unsigned zerofill DEFAULT NULL,
`Local` int(10) unsigned zerofill DEFAULT NULL,
`VideoPhone` int(10) unsigned zerofill DEFAULT NULL,
`Commercial` int(10) unsigned zerofill DEFAULT NULL,
`Other` int(10) unsigned zerofill DEFAULT NULL,
`Wire` int(10) unsigned zerofill DEFAULT NULL,
`SatTV` int(10) unsigned zerofill DEFAULT NULL,
`ENE` int(10) unsigned zerofill DEFAULT NULL,
`HomeSecurity` int(10) unsigned zerofill DEFAULT NULL,
`Internet` int(10) unsigned zerofill DEFAULT NULL,
`Nutritional` int(10) unsigned zerofill DEFAULT NULL,
`Total` int(10) unsigned zerofill DEFAULT NULL,
`TTQualPts` int(10) unsigned zerofill DEFAULT NULL,
`INC` int(10) unsigned zerofill DEFAULT NULL,
`Preferred` int(10) unsigned zerofill DEFAULT NULL,
`TotalDownlineCustomerPoints` int(10) unsigned zerofill DEFAULT NULL,
`totalCustomerPoints` int(10) unsigned zerofill DEFAULT NULL,
`DirectlySponsoredQualifiedTTs` int(10) unsigned zerofill DEFAULT NULL,
`CurrentCommissionLevelEarned` varchar(45) DEFAULT NULL,
`PreviousCommissionLevelEarned` varchar(45) DEFAULT NULL,
`QualifiedTeamTrainer` varchar(45) DEFAULT NULL,
`GracePeriodExpirationDate` varchar(45) DEFAULT NULL,
`PersonalCommissionVolume` varchar(45) DEFAULT NULL,
`DownlineOrganisationTotalBilling` varchar(45) DEFAULT NULL,
`Legs100` int(10) unsigned zerofill DEFAULT NULL,
`Legs200` int(10) unsigned zerofill DEFAULT NULL,
`QTTLegs` int(10) unsigned zerofill DEFAULT NULL,
`ETTLegs` int(10) unsigned zerofill DEFAULT NULL,
`TCLegs` int(10) unsigned zerofill DEFAULT NULL,
`RDLegs` int(10) unsigned zerofill DEFAULT NULL,
`SponsorName` varchar(45) DEFAULT NULL,
`SponsorTeam` varchar(45) DEFAULT NULL,
`TCpie1` int(10) unsigned zerofill DEFAULT NULL,
`TCpie2` int(10) unsigned zerofill DEFAULT NULL,
`TCpie3` int(10) unsigned zerofill DEFAULT NULL,
`Home` varchar(45) DEFAULT NULL,
`Cell` varchar(45) DEFAULT NULL,
`video_phone` varchar(45) DEFAULT NULL,
`other_phone` varchar(45) DEFAULT NULL,
`Actual_Name` varchar(45) DEFAULT NULL,
PRIMARY KEY (`id`)

MySQL PHP XML

ID Projek: #1455693

Tentang projek

9 cadangan Projek jarak jauh Aktif Mar 23, 2012

9 pekerja bebas membida secara purata $93 untuk pekerjaan ini

waelfree

Hi, I can do that

$50 USD dalam sehari
(103 Ulasan)
7.0
marchent

Let start a conversation at PMB.

$100 USD dalam 7 hari
(161 Ulasan)
6.2
reco233

Let me help you with this sir!

$200 USD dalam 5 hari
(23 Ulasan)
5.5
atatzkie87

Hi, I have expertise on this field, kindly assign to me and lets start immediately. Thanks, atatzkie87

$200 USD dalam 0 hari
(6 Ulasan)
3.6
PPPsolution

Eager to help.

$50 USD dalam 2 hari
(2 Ulasan)
3.5
nextratel

Hello sir. I have a lot of experience in web scrapping and i can complete this project as required. Please see PM for more details.

$50 USD dalam 3 hari
(1 Ulasan)
1.4
pl2k

please see my pm

$30 USD dalam 5 hari
(0 Ulasan)
0.0
oasissoftwareinc

Hi, I have over 12 years of Experience in software design, development and implementation of various commercial applications in Client/Server environment, Web and ERP applications using C# 1.1/2.0/3.5, ASP.Net, VB.N Lagi

$75 USD dalam sehari
(0 Ulasan)
2.5