You can download the scraper class here.

There’s a quick sample for how to use the scraper class below my slide deck from the meetup:

Using the Scraper:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16

<?php
require_once('Scraper.php');
$scraper = new Eppie_Service_Scraper();
 
/* if you want to use proxies, list them as an array 
and pass into the setProxies method. Note that the
ip addresses listed here are not real proxies. */
$proxies = array(
    '123.123.123.123',
    '111.111.111.111'
);
$scraper->setProxies($proxies);
 
$scraper->scrape('http://www.cnn.com');
var_dump($scraper);
?>

And here’s the actual scraper class:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130

<?php
class Eppie_Service_Scraper{
 
    public function __construct(){
        // set proxies -- you can add your own here or use the setProxies method
        $this->_proxies = array();
    }
 
    public function scrape($url)
    {
        $this->_url = $url;
        $dom = new DOMDocument();
    	$proxy = $this->_pickProxy();
 
    	$ch = curl_init();
    	curl_setopt($ch, CURLOPT_URL, $url);
    	curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
    	curl_setopt($ch, CURLOPT_REFERER, "");
    	curl_setopt($ch, CURLOPT_FOLLOWLOCATION,1);
    	curl_setopt($ch, CURLOPT_USERAGENT, "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_6) AppleWebKit/535.19 (KHTML, like Gecko) Chrome/18.0.1025.151 Safari/535.19");
    	if($proxy){
        	curl_setopt($ch, CURLOPT_PROXY, $proxy); 
        	curl_setopt($ch, CURLOPT_HTTPPROXYTUNNEL, 1);
    	}
    	$body = curl_exec($ch);
    	curl_close($ch);
 
    	$this->_curl_result = $body;
    	@$dom->loadHTML($body);
    	$this->_dom = $dom;
 
    	$this->_parseDOM();	
    }
 
    public function setProxies($proxies)
    {
        $this->_proxies = $proxies;
    }
 
    private function _pickProxy()
    {
        if(count($this->_proxies) > 0)
            return $this->_proxies[rand(0, count($this->_proxies) - 1)];
        else return false;
    }
 
    public function setKeyword($keyword)
    {
        $this->_keyword = $keyword;
    }
 
    private function _parseDOM()
    {
        $xpath = new DOMXPath($this->_dom);
        $title = $xpath->query("//head/title");
        $meta_desc = $xpath->query("//head/meta[@name='description']/@content");
        $meta_kw = $xpath->query("//head/meta[@name='keywords']/@content");
        $h1 = $xpath->query("//h1");
        $h2 = $xpath->query("//h2");
        $h3 = $xpath->query("//h3");
	$h4 = $xpath->query("//h4");
	$h5 = $xpath->query("//h5");
	$h6 = $xpath->query("//h6");
        $img = $xpath->query("//img");
        $img_alt = $xpath->query("//img[@alt!='']/@alt");
        $strong = $xpath->query("//strong | //b");
        $body = $xpath->query("//body");
 
        if($title->length > 0)
            $this->_title = $title->item(0)->nodeValue;
 
        if($meta_desc->length > 0)
            $this->_meta_desc = $meta_desc->item(0)->nodeValue;
 
        if($meta_kw->length > 0)
            $this->_meta_kw = $meta_kw->item(0)->nodeValue;
 
        if($h1->length > 0)
        {
            for($i=0; $i < $h1->length; $i++)
                $this->_h1[] = $h1->item($i)->nodeValue;
        }
 
        if($h2->length > 0)
        {
            for($i=0; $i < $h2->length; $i++)
                $this->_h2[] = $h2->item($i)->nodeValue;
        }
 
        if($h3->length > 0)
        {
            for($i=0; $i < $h3->length; $i++)
                $this->_h3[] = $h3->item($i)->nodeValue;
        }
 
	if($h4->length > 0)
        {
            for($i=0; $i < $h4->length; $i++)
                $this->_h4[] = $h4->item($i)->nodeValue;
        }
 
	if($h5->length > 0)
        {
            for($i=0; $i < $h5->length; $i++)
                $this->_h5[] = $h5->item($i)->nodeValue;
        }
 
	if($h6->length > 0)
        {
            for($i=0; $i < $h6->length; $i++)
                $this->_h6[] = $h6->item($i)->nodeValue;
        }
 
        if($img_alt->length > 0)
        {
            for($i=0; $i < $img_alt->length; $i++)
                $this->_img_alt[] = $img_alt->item($i)->nodeValue;
        }
 
        $this->_img_alt_pct = ($img_alt->length / $img->length)*100;
 
        if($strong->length > 0)
        {
            for($i=0; $i < $strong->length; $i++)
                $this->_strong[] = $strong->item($i)->nodeValue;
        }
 
    }
 
}

The above image is a quick glance at a project I’ve been working on.  Hoping to roll it out before the end of the year…

Maybe you’ve even taken it a step further — “Isn’t that impossible to suck at?  Show up and attend the seminars… shake hands with people, give them my card.  I’m a live event superstar.  You suck, Eppie… not me.”

Don’t lie. I know you’re thinking it.

Seriously, You Suck at Attending Live Events

This past weekend, I attended an internet marketing conference — JV Alert Live in Washington DC… and I almost sucked at attending it, too.  I almost didn’t sit at the bar instead of attending a session.  I almost went to bed early each night so I’d be bright-eyed and bushy-tailed when the next day’s events started.  I almost missed out on making real relationships.

I’m not saying you should go to an event and blow off all the organized stuff, but I am saying that you shouldn’t feel obligated to stay on schedule.

It wasn’t until 9:00 on Saturday night (I arrived at the conference on Thursday afternoon) that I stopped sucking.  That’s when Rick Toone, Larry Tosten, and I started filming Drunk Marketing Tips… and I KNOW that’s when people decided I was someone worth keeping in touch with… because I let loose and started being me.  Here’s that video:

When DMT wrapped, Bill Clemens, Bill Leopold, and Bryan Levens joined me in the Westin’s mens room to film Bathroom Tai Chi:

I think those videos turned out to be quite funny, but it’s not the quality of the video that matters.  I did something memorable with these guys.  Working together on something made them memorable to me. It’s the reason I didn’t need to hunt down their names to reference them in the sentence above.  We had a blast, and left that conference with a great impression of each other.  That’s huge.

Follow Up FTW

So we started with a WTF and now we’re reversing it (double reverse, even?) for the win (FTW).  Ira Rosen (super smart and personable dude from Mojo Video Marketing) gave an awesome tip in the Drunk Marketing Tips video about following up with people via video, particularly with great speakers.  Killer idea.

Likewise, if you can produce some sort of recap video or an event overview (check out my buddy Tom Harari’s recap post for the NOLA Linklove conference for a text-based example), that will also put you in front of the right people again and leave a GREAT impression.

REMEMBER: You can learn things online, through a book, or a membership site.  It’s much harder to forge lasting relationships that way.  Live events = relationship starters.

Through a little research, I was able to find a great search term that has relatively little competition, and I’ve started to rank for its long-tail variants.  The root term is parenting quotes, and the long-tail that I’m ranking for is inspirational parenting quotes.

Why is this such a great term?  Parenting quotes gets 3,600 exact match searches per month and nearly 15,000 broad match searches.  Inspirational parenting quotes get a more modest 210 exact match searches per month, but that’s still 7 per day.  The real key to these terms isn’t their volume though — it’s the limited competition to rank for them.  Note that for all stats below, I’m going to list my ranking — it may be different for you if you do a search, since we’re likely hitting different data centers.  They should be close though.

Details for Inspirational Parenting Quotes:
** All stats are for exact match (ie allintitle:”inspirational parenting quotes” — not allintitle:inspirational parenting quotes) — this shows sites that are most aggressively targeting the term.
Allintitle matches: 209 results (I’m number 1)
Allinurl matches: 20 results (I’m number 1)
Allinanchor matches: 7 results (I’m number 1)

Guess what?  Do an exact match search for the term and… I’m number 1.

Now let’s broad match those same stats and see how we do:
Allintitle matches: 310 results (I’m number 4)
Allinurl matches: 92 results (I’m number 2)
Allinanchor matches: 3,440,000 results (I’m number 4)

Building a few links to this page should secure the top spot for this search term.  The great news is that targeting this term, which is pretty easy to rank for also lets me target the much more difficult (but still surprisingly poorly targeted) term “parenting quotes.”  Let’s look at the data:

Details for Parenting Quotes:
Exact Match Stats:
Allintitle matches: 1,760 results (I’m number 12)
Allinurl matches: 701 results (I’m number 5)
Allinanchor matches: 46,200 results (I’m number 13)

On an exact match search for “parenting quotes,” I’m currently number 13 (number 16 on a broad match).  The allintitle and allinurl numbers for this term are VERY low given its search volume.

Broad Match Stats:
Allintitle matches: 7,740 results (I’m number 15)
Allinurl matches: 4,090 results (I’m number 7)
Allinanchor matches: 2,630,000 results (I’m number 15)

As you can see, I’m approaching competitive rankings for these terms, and I haven’t even started building links toward them.

The area immediately after a post is fairly prime real estate.  It’s where you can give a natural follow-up action for your visitors… and I gave them ALL of them.  The only problem was the one that I really want them to do right now was given the least emphasis.

So What Do You Want Visitors to DO?

I want people to comment on articles on the site.  And for those people who prefer not to comment, I want them to at least be able to read the additional contributions added by other readers.  That’s what rings true to the mission of Better Parenting – to crowdsource parenting advice.  You don’t need to have a PhD to contribute and improve the collective parenting skill of our readers.  So I eliminated some of the extra stuff at the bottom (popular posts, related posts), added more emphasis to the comment text, and made mention of the “Comments Count” contest that I’m running.  I’m going to do more with this too.  I should have additional changes rolled out tomorrow.

I’ve also made some other changes to the individual article pages:

• I increased the size of the main image and placed it directly above the headline.
• I increased the size of the headline and improved its styling by choosing a better font and color.
• I removed the large (and distracting) categorization box that was previously above the headline.
• I improved line spacing in the articles.

I did all of these things to increase the likelihood that someone will get to the bottom of the article — where the other changes should encourage them to comment.  It’s important to regularly remind yourself what you want people to do on your site, then do whatever you can to make it easier for them to do it.

I work in web development and internet marketing.  Not the sleazy, dirty, 8 mile-long page with 40 fake testimonials and yellow highlighted text internet marketing.  I’m talking internet marketing for legitimate companies.  So I should know better than to send out an email newsletter on Good Friday after lunch…  But I did it anyway.

Fridays are generally bad days for email.  Open rates tend to be lower.  People are either trying to finish their work so they can get out of the office for the weekend or they’re already busy planning / starting the weekend.  In the middle of the week, you’re more likely to catch people bored at work, looking for something (anything) to capture their interest.

Holidays are even worse.  People are traveling, fewer people are at work… they’re just not looking for something to catch their attention.

None of this is news to me, but I still sent out a newsletter this afternoon.  In part, it’s because of necessity… I launched a contest and I want to get the word out.  In part it’s because I was tired of putting it off any longer.  But no matter what the reasoning, I’m going to suffer from reduced open rates for this campaign.

It sucks that open rates will be down, but it feels good to have actually started sending the weekly newsletter.  Next week, I’m going to split-test timing and report on its impact on open rates with my list.  I’m not likely going to use Friday afternoon as one of my test segments, however.

• Surpassed goal of 10,000 pageviews (had nearly 11,000 views on 4,300 visits).
• List capture worked well with the Target giveaway, adding just shy of 100 names to the Parenting newsletter.  The first newsletter was sent today using MailChimp’s RSS to email.  I configured WordPress to hide a specific category (Parenting Tip of the Week), so it only appears in the RSS feed.  Since MailChimp pulls the RSS feed for publishing the newsletter, it includes this category.  I schedule the tip of the week to post right before MailChimp is scheduled to send the newsletter, and the tip appears at the top of the message exclusively for newsletter subscribers (and RSS feed readers).  I think it’s a pretty smart setup.  You can sign up for the newsletter here.
• Winning technological battles (RSS to email solution) is easy for me.  The harder part is traffic generation, etc.  Search traffic continues to improve and is providing a solid 20+ visitors per day.  I’m starting to rank for more competitive terms as well.  I hope at the end of this month to receive between 50 and 100 search visits daily.  I’ll have to plan topic titles more carefully this month to ensure that it happens (and continue link building).
• I hadn’t mentioned Twitter in past posts because I was in a holding pattern for weeks… since someone else had reserved the BetterParenting name on Twitter.  Thankfully, I was able to register BetterParents and make a trade with the other party.  I think this is a HUGE WIN!  If I had to use the name BetterParents, it would hurt my branding.  Making the switch was extremely important to me.  It took several weeks to complete, but I think Twitter will be very helpful in making some social connections with related sites.
• My stable of writers continues to grow.  A friend from high school who is a very talented writer started writing articles for the site.  My brother’s neighbor is also going to start writing – from brief encounters with her in the past she seems to be very bright and a great mother.  She also has relevant educational and professional experience.  Two great assets.
• I learned a lot from the Target giveaway.  It worked to increase traffic and build links, so I’m glad I ran it.  I wish I could have had Twitter up and running for a bonus opportunity, but I couldn’t get the name transfer worked out in time.  This month’s giveaway may get fewer entries, but I think it will do more for my site long-term.
• The giveaway for this month is structured more around loyalty and community.  That’s what I want to build, so I’m trying to reward it.  Every comment made on Better Parenting this month counts as an entry (so go comment already! – I publish daily, so there’s bound to be something you’ll find interesting).  Following @BetterParenting on Twitter gains bonus entries and retweeting about the contest also results in bonus entries.  Hopefully this will create a habit for people to check back with the site daily and to comment on new content.
• I just got an email from Bill Dwight from FamZoo – he’s going to be guest posting this week.  We initially discussed this guest posting opportunity in mid March, and Bill came through with a great post – it is AMAZING!  I feel so incredibly lucky to have run across Bill and can’t wait to publish his article.  I’m going to schedule it for Monday morning so it can get the best possible exposure.
• Ad revenue was down for the second half of the month.  I moved down the top 300 x 250 block in the sidebar to feature my RSS feed and newsletters, and its CTR suffered a bit.  I also started running more CPA ads, and they haven’t converted yet, so those are clicks I would have made something from with Google.  I’m going to keep running the CPA stuff for now and see if conversions pick up.  I’m really hoping to push up to 30,000 plus pageviews soon so that I can start to pursue CPM advertising.  I think it’s a better fit for the site.

  On a related note, I can’t stop thinking about th Chevy Traverse, and I’ve never clicked on any of their ads… I just see them all over the place.  CPM works for major brands.

  OpenX Marketplace brought in some extra cash, which is worth noting.  You can set a CPM floor, and if advertisers will bid above it, it preempts your other ads.  It’s nice to score a few extra dollars, even if I’m not ready to go CPM for the whole site.

I still need to work harder on my “ground game.”  I know a lot of people locally who could benefit from the site, but I keep hesitating to push it because I want it to be perfect before sending people I know to it.  Quite frankly, it’s a terrible excuse and I need to man up.

If Content is King, Social is Queen

This month will continue to be about good content and making relationships online.  I would love to join the Extraordinary Life Network this month, or at least guest post on some of their sites.  I’ve been following the RSS feeds of their sites for a while, and I’m very impressed with where they’re going.  I origianlly found the network through member site Engaged Marriage (via a guest post on Pro Blogger).  Engaged Marriage is an impressive site that was launched within the last year.  Growth curve is impressive (and totally merited – he publishes good stuff).  I see big things for them because they’re building strong communities.  Although my site is different from theirs in that it has less personal focus (multi-author vs. individual tends to do that), I think we stand for a lot of the same things.

On a side note, I’m probably going to move off of WordPress and on to a custom Zend Framework solution by the end of the month.  I’m building an application that’s geared toward running a multi-author site and has my workflow in mind.  It will be nice having the additional flexibility of a custom solution.  Still, that’s low priority, since the tech stuff won’t make or break me – it’s content and relationships that yield a winner online.

Get More by Giving More

I’ve been sitting on a post about Dad blogs I like for a couple of weeks now, but it’s going to go live this week.  I’m also going to do a few other roundup articles and link out more liberally.  You get love by giving love, and I’m going to put that principle into practice this month.  This is another thing I’ve been meaning to do, but I didn’t want to jump the gun – linking out before I had established my site.  That’s selfish.  I’m going to publish this post (and others like it) because I think they’re worth sharing to my readers and the people I’m linking to deserve the support.

Goals for this month

• 30,000 pageviews
• At least 1 guest post per week on another related blog
• Minimum 250 RSS subscribers (currently at 111)
• At least 200 good comments this month on my blog (contest should help)
• 50 search visitors per day (by the end of the month)
• 300+ Twitter followers (by the end of the month)
• Membership in ELN?

One of the big goals was to try to make the site more “sticky,” so I featured the RSS feed and setup an email newsletter opt-in.  I continued to focus on publishing good content with good images, which I think goes a long way with readers.  The site already had related posts and popular posts running, which also helps to keep readers on board and looking at more pages.  I may change the formatting of that to make it less cumbersome, however.

Anyway, here’s a quick overview of the week’s highlights (and lowlights):

• Continued publishing at least 1 article per day.  I think overall the article quality is good.  I’m still aiming for continued improvement.
• Search traffic continued to trickle in.  Still under 20 search visitors per day, so it’s a small portion of traffic, but it’s better than nothing.
• Commented on a few blogs with the Top Commentators plugin instaled, which added a bunch of links.  I try to add value with my comments but still feel a little shady about this approach.  As a result, I’ve been less aggressive with this tactic than originally planned.  It’s created a trickle of traffic, but the value here is clearly more for the link (and catching the attention of the blog owner), not for an average visitor of the site clicking through.
• Yahoo is now showing over 1,200 new links.  Not bad for 2 weeks.
• AdSense continued to provide a little income.  CTR is much too low.  The new 336 x 280 ad block at the bottom of the post is performing the best.
• I started serving CPA ads via OpenX, but no conversions yet.  I’m running Hooked on Phonics and TheCuteKid offers so far.  CTR has been better than adsense.  Conversions obviously haven’t.
• I was late in getting my newsletter subscription box in place, and that probably cost me a few subscribers.  I’m trying to make up for lost opportunity by driving additional traffic to the site now that it’s live (and promoting it with a giveaway).
• Giveaway went live today.  Later than it was supposed to, but I’m already getting a good response from it.  RSS subscribers and list submissions are growing nicely today… hopefully they stick around and don’t bail once the contest ends.
• I’ll be posting some pointers for running a giveaway in another post.
• Traffic was down.  Under 3,000 pageviews this week.  I expected some dropoff from people coming to the site to apply for the writing job I posted on March 1.  Still, decent traffic for week 2.

The Big Failure of the Week

Not everything goes according to plans.  I put $25 towards StumbleUpon Ads to send 500 visitors to my site.  I was hoping to make an article go viral… didn’t happen.  And the Stumblers didn’t do a lot of cruising through the site.  Still, I did get a few email subscribers from the traffic, so not all was lost.  It did affirm for me that I need to build the site the right way though — I don’t want flash-in-the-pan traffic.  I want to build community.  I want to give value.  People will keep coming back, promote the site for me, and contribute more if I give them a reason to.

I’m still happy with where things are going, even though this week wasn’t a huge success.

Week 3 Plans

This coming week I’m looking for increased search traffic, increased list signups, and a lot of content being published.  As I fill up more categories, I think I’ll be better positioned to pitch a blog network I admire for membership.  Leveraging the loyal readers of another blog may help increase loyalty (and community) on my own site.

I’m also going to get my “ground game” going this week.  I’m going to pitch the site to a bunch of ladies from church, and try to get them to be active readers (and hopefully contributors).  Loyalty begins this week!

To keep myself from going insane, I decided to implement OpenX to serve all of my ads.  It allows me to serve CPA, CPM, and CPC advertisements, so I’m already set for when traffic increases to the level of selling my own CPM ads.  Plus, it’s free!  I’ve only added a few advertisers so far, but I’m definitely enjoying the setup.

I’ll be posting again this evening with a follow-up on some of the things I’m doing to publicize the site.

Week 1 Wins

• Published at least 1 article every day (22 articles now published)
• Over 1,000 visitors for the week
• Over 3,500 pageviews for the week
• More than 3 pageviews per visitor (average)
• Alexa Ranking (3 month average) under 1 million (883,879)
• Alexa Ranking (1 month average) under 500,000 (329,187)
• Started getting search traffic
• 129 pages indexed by Google (up from 7 in the previous owner’s site)
• Over 100 new links indexed by Yahoo
• The site made some money via adsense
• Received visits from every state in the US plus 37 additional countries

Week 1 Losses

• Search provided only 6% of traffic (and a lot of those were direct navigation attempts)
• A large percentage of traffic came from writers interested in a paid writing position for the site, not a group that’s likely to be strong repeat visitors
• Roughly 2% of site visitors subscribed to RSS feed – I hoped this number would be 5% or higher.
• The adsense CTR was too low (the earnings per click were really strong though)

I didn’t go crazy promoting the site yet, since I’m still trying to build up a solid content base.  I want there to be clear value when people land on the site, and I want their to be enough additional content for the site to be sticky.

I think I’m close to that point, so this week I plan on doing a lot more promotion.  I just announced the launch of the site on my facebook feed, and encouraged friends to become contributors to the site.  I’d be thrilled if I could get another writer or two from this effort.  I’ll be sure to post how that goes as a follow-up.  Unfortunately, I’m not super active on Facebook, so I don’t know that it’s going to be a big winner.  It’s still worth doing.

Plans for Week 2

Below are the tactics I plan to implement this week.  I’ve included the goal they target in parentheses:

• Feature the RSS feed more prominently (build visitor loyalty)
• Add in an email subscription signup for a weekly newsletter plus special discount offers (build visitor loyalty)
• Publish at least 1 article per day, preferably 2 (increase pageviews, increase search traffic)
• Comment more on related blogs (increase traffic, build links)
• Add 3rd adsense block and experiment with placement (increase adsense CTR)
• Integrate CPA advertising (increase earnings)
• Announce some kind of contest on the site (linkbait, increase traffic)
• Ask for links from friends with compatible sites. (increase traffic, build links)