Which were your marketing strategies to grow your business?
Dan took care of the marketing internally when he founded Scraper API. He and the early team would regularly contact developer blogs for tutorials, and sponsor developer blogs and Youtube channels to spread the word about the tool. They also started our affiliate program.
We had mostly relied on blog posts for new visitors and organic traffic. The early team had started to see traction with a blog post explaining the types of companies that use web scrapers. This continued with top-10 lists about different aspects of web scraping.
Now, we are prioritizing improving our marketing strategy - with help from outside contractors and further investment made in SEO, we hope that by reworking our website, we will create more unique pages that draw people in, and improve user experience.
How are you doing today and what are your goals for the future?
The team includes a marketing strategist, software engineers, other entrepreneurs, and investors. We’ve got Ian Kerins who has tons of industry knowledge and is in charge of marketing. We have Ian Williams, our senior engineer who was an original member of the Scraper API team before the acquisition, and who does the heavy lifting for our current team. And we have Tim, Tobias, and Ulrich who co-founded our parent company, SaaS.group. Tim and Ulrich are entrepreneurs and investors who’ve made a huge impact in Germany, and Tobias has had tons of startup experience in the country too. My teammates’ wealth of knowledge, interesting ideas, and kindness are unmatched and something I highly value.
I am happy to say that we are off to a great start with the changes we have been implementing! We are hoping to hire more employees this year, and hopefully, the Scraper API family will be able to continue to grow afterward. Most scraping companies and startups operate in the shadows because data scraping is still perceived negatively by many large sites (mainly the ones that are often being scraped). Scraper API is different. And especially since SaaS.group acquired it, we're focusing more and more on privacy-enabled scalable data retrieval. While we strongly believe that information publicly available on the Internet is free to scrape, we always try to ensure that people's private information is a no-go area. Our long-term plan is to transform into an enterprise-grade scraping service with all the required features and throughput that large companies depend on.
Since acquiring Scraper API, what have been your main lessons?
One of the biggest lessons I have learned from my time with Scraper API is that patience and a supportive team are vital to a successful acquisition and transition period. Even if you feel like you have all the information in the world about the business you’re acquiring, there are many unknowns and surprises to continuously work through. If you’re part of a great team everyone can help each other out, which helps everything come together faster.
Luckily we took over the team too during the acquisition, and we could rely on their vast knowledge of the domain. Since I've mainly worked with enterprises in the past (LogMeIn, T-Systems...etc), a lesson I have also learned is that startups that got momentum early on have a lot of skeletons in the closet, that you have to either learn to live with or dedicate time to work through them.
Scraping is a constant cat and mouse fight - it’s a bit similar to what advertisers and ad-blocker apps do. The technology we build is unbelievably advanced when it comes to staying on top of the newest blocking techniques; the cat-mouse fight was a manual thing in the past, but we are building newer, more autonomous ways to stay unblocked.
What were the biggest obstacles you overcame? What were your worst mistakes?
The main obstacle for us was having to get familiar with the technology. As Scraper API was a mature company during the acquisition, we wanted to ensure we understood what had already been set in stone, and how to make any changes when taking over. A scraping platform is not a highly scalable CURL (client URL) library. The source code virtually has years of experience hardcoded into it, with evidence of all the living past of what customers have asked for over the years. Looking at it is like looking at the age lines of a tree. While it was challenging to get accustomed to the product, we had a 6-month transition period in which Dan guided us.
As head of the engineering team, one always has to juggle between working on killing off technical debt, satisfying the daily needs of our customers, and delivering new features and improvements. That's a difficult task and I know we don't always manage to do it the right way.
An obstacle that the team faced before the acquisition was with accounting; Dan has mentioned it would have been ideal to have hired someone earlier on to take care of it. Cleaning up finances and migrating to a new charging system was key to starting 2021 with a stable product, and with big plans.
We use the CanIRank tool to help us with our SEO and to utilize its suggestions for ways to improve our inbound marketing efforts. Snip.ly is awesome for shortening links, and Prerender is a useful resource for introducing coding to our page that enables it to show up higher on search engine pages.
Some books that are very important to me are Managing Humans: Biting and Humorous Tales of a Software Engineering Manager by Michael Lopp, Emotional Grit by Dr. Neeta F Bhushan, and Don’t Make Me Think by Steve Krug. Managing Humans is both hilarious and helpful for people who oversee teams, Emotional Grit helps me lead more compassionately, and Don’t Make Me Think is just a classic for developers that I enjoy going back to from time to time.
Where can we go to learn more?
Here is my LinkedIn. We’ve got some great info about web scraping and related topics on our blog.
