• Twitter
  • LinkedIn
(503) 212-0687 | hello@cascadeinsights.com
Cascade Insights
  • Market Research Services
    • B2B Customer Experience Research
      • Buyer Personas
      • Buyer’s Journey Research
      • Key Buying Criteria Research
      • Jobs-To-Be-Done Research
      • User Personas
      • Customer Satisfaction Research
    • B2B Product/Service Research
      • Market Opportunity Research
      • Concept Testing
      • Go-To-Market Research
    • B2B Marketing Enablement Research
      • Data-Driven Marketing Research
      • Message Testing
      • Brand Research
      • Thought Leadership Services
      • Partner Enablement
    • B2B Sales Enablement Research
      • Competitive Landscape Analysis
      • Win-Loss Research
      • Churn Analysis
      • Channel Research
  • Marketing Services
    • Marketing Strategy
    • Messaging
    • Content Marketing
    • Sales Enablement
  • Insights and Perspectives
    • B2B Market Research Blog
    • B2B Marketing Blog
    • B2B Resources
  • About Us
    • Our Story
    • Our Clients
    • Client Testimonials
    • Careers
    • Ethics Policy
    • Privacy Policy
  • Contact Us
  • Search
  • Menu Menu

The “Competitive Intel” Episode 5 Transcript – Reporters and Competitive Intelligence

March 18, 2012/in Blog Posts /by Sean Campbell
Share this entry
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share by Mail

What Competitive Intelligence Can Learn from Investigative Reporters

News reporters use an intriguing mix of tools that directly correlate to competitive intelligence work, particularly in terms of mining the web. In short, investigative reporters have deep expertise in gathering data from its hiding places and making sophisticated conclusions from it. The competitive intelligence field can learn a lot from theirs through events such as the Computer-Assisted Reporting Conference, which we recently attended.

Scraping Data Rapidly from Web Pages with Scrapely

Screen scraping lets you rapidly gather information from a site and put it into a different form. Tools like Scrapely, a Google Chrome browser extension, let users rapidly gather even very large data sets from websites, in many cases simply by highlighting a chunk of data and selecting a command from the right-click menu. The tool outputs a neat table automatically, which you can then export to Google Docs.

For more complex page formats, Scrapely includes the ability to create a parser from a set of examples that can be automatically applied to similar pages. Note that you should check the terms of use for any data source you intend to use with Scrapely or other data scrapers before using them.

Automating Information Grouping with Google Refine

In most cases, competitive intelligence practitioners don’t suffer from a lack of data; more often, the challenge is to make sense out of an ocean of it. Computer algorithms are the clear answer, and no one creates those better than the folks at Google. When you have 1,000 headlines and 20,000 Tweets on a competitor, Google Refine can analyze them automatically and place them into clusters, according to topic.

The time savings associated with an automated approach such as what you can do with Google Refine can easily make the difference between having to simply take samples from a body of data, versus being able to detect the patterns and underlying significance from an entire data set.

Visualizing the World of Data with NodeXL, Twiangulate, and Junar

The primary factors associated with how and why customers are being driven to a specific competitor are often hard-to-quantify ones, such as reputation and referrals. To understand that dynamic, you need to know how influence is being generated, and by whom. NodeXL graphs the social-network connections from an influencer to other people. Twiangulate shows mutual followers and friends between two or more influencers’ names you enter.

Another challenge is that most online data changes constantly, so reports may rapidly become outdated. Junar helps by collecting web data, automatically placing it into dashboards, and updating it dynamically as the source changes. Tools such as these can dramatically improve your ability to tame huge data sets and make fast, high-quality conclusions.

 

Get in touch

"*" indicates required fields

Name
Cascade Insights will never share your information with third parties. View our privacy policy.
This field is for validation purposes and should be left unchanged.
  • Bio
  • Twitter
  • LinkedIn
  • Latest Posts
Sean Campbell

Sean Campbell

CEO
Sean Campbell is the CEO of Cascade Insights, a competitive intelligence and market research firm for B2B technology companies. A 20-year technology veteran, Sean oversees the health of the firm, drives the company’s thought leadership efforts and maintains relationships with key clients.
Sean Campbell

@sean_campbell

Sean Campbell
Sean Campbell

Latest posts by Sean Campbell (see all)

  • B2B Market Research: Exposing the Truth - August 23, 2022
  • B2B Focus Groups: Virtual for the Win - June 7, 2022
  • B2B Buyer’s Journey: Buyers and Marketers in the Blender - March 8, 2022
Tags: competitive intelligence
Share this entry
  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
  • Share by Mail
You might also like
The Spy Who Wasn't: Clarifying Competitive IntelligenceThe “Competitive Intel” Episode 23 Transcript – eBooks you should know in 2013
Stall Points and Market AssumptionsAre Your Market Assumptions Still True?
The Spy Who Wasn't: Clarifying Competitive IntelligenceThe “Competitive Intel” Episode 1 Transcript – CES and Trade Show Intelligence
Sales Needs A Say In StrategySales Needs A Say In Strategy
The Spy Who Wasn't: Clarifying Competitive IntelligenceAnnual Investigative Reporters & Editors Conference
The Spy Who Wasn't: Clarifying Competitive IntelligenceThe “Competitive Intel” Episode 9 Transcript – Reverse Engineering a Competitor Customer List
The Spy Who Wasn't: Clarifying Competitive IntelligenceThe “Competitive Intel” Episode 18 Transcript – Human Intelligence – Part I
The Spy Who Wasn't: Clarifying Competitive IntelligenceThe Spy Who Wasn’t – Clarifying Competitive Intelligence

GET IN TOUCH

hello@cascadeinsights.com

(503) 898-0004

WHAT WE DO

Market Research Services
Marketing Services
Subscribeto RSS Feed

Blog Categories

  • B2B Buyer Persona Research
  • B2B Channel Market Research
  • B2B Churn Analysis
  • B2B Competitive Landscape Analysis
  • B2B Customer Experience Research
  • B2B Customer Journey Mapping
  • B2B Go-To-Market Research
  • B2B Market Opportunity Research
  • B2B Market Research Blog
  • B2B Market Segmentation Research
  • B2B Marketing Blog
    • Uncategorized
  • B2B Messaging
  • B2B New Product Launch Research
  • B2B Thought Leadership
  • B2B Usability Testing
  • Brand Research
  • Concept Testing
  • Content Marketing
  • Customer Satisfaction Research
  • Data-Driven Marketing Research
  • Jobs-To-Be-Done
  • Key Buying Criteria
  • Marketing Enablement
  • Marketing Strategy
  • Message Testing Research
  • Partner Enablement
  • Product/Service Research
  • Sales Enablement Marketing
  • Sales Enablement Research
  • User Personas
  • Videos
  • Win/Loss Analysis

Written by

Sean Campbell
Sean Campbell

RECENT POSTS

  1. The “Competitive Intel” Episode 1 Transcript – CES and Trade Show Intelligence
  2. The “Competitive Intel” Episode 11 Transcript – Books every Competitive Intelligence professional should own
  3. The “Competitive Intel” Episode 19 Transcript – Understanding the Technology Adoption Lifecycle
  4. The “Competitive Intel” Episode 27 Transcript – Value Chain Analysis

Connect With Us

503.212.0687

hello@cascadeinsights.com

  • LinkedIn
  • Twitter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

B2B Market Research

  • Customer Experience Research
  • — Buyer Persona Research
  • — Buyer's Journey Research
  • — Key Buying Criteria Research
  • — Jobs-To-Be-Done Research
  • — User Personas
  • — Customer Satisfaction Research

  • B2B Product/Service Research
  • — Market Opportunity Research
  • — Concept Testing
  • — Go-To-Market Research

  • Marketing Enablement Research
  • — B2B Data-Driven Marketing Research
  • — Message Testing
  • — Brand Research
  • — Thought Leadership
  • — Partner Enablement

  • Sales Enablement Research
  • — Competitive Landscape Analysis
  • — Win Loss Analysis
  • — Churn Analysis
  • — Channel Research

B2B Marketing

  • — B2B Marketing Strategy
  • — B2B Messaging Services
  • — B2B Content Marketing
  • — B2B Sales Enablement

About Us

  • — Our Story
  • — Our Clients
  • — Client Testimonials
  • — Careers
  • — Ethics Policy
  • — Privacy Policy

Blogs

  • — B2B Market Research Blog
  • — B2B Marketing Blog
  • — Cascade Insights Blog
Cascade Insights is proud to be a member of the Inc. 5000.
The “Competitive Intel” Episode 4 Transcript – Analysis of Competing...The “Competitive Intel” Episode 6 Transcript – Win / Loss for...
Scroll to top