Download PDF
Investing.com Employs Signal Sciences to Thwart Data Scraping Bots
Technology Category
- Analytics & Modeling - Robotic Process Automation (RPA)
- Application Infrastructure & Middleware - Event-Driven Application
Applicable Industries
- Electrical Grids
- National Security & Defense
Use Cases
- Chatbots
- Edge Computing & Edge Intelligence
The Challenge
Investing.com, a global financial portal and internet brand, was grappling with a significant challenge. The company, which provides news, analysis, streaming quotes, charts, technical data, and financial tools about the global financial markets, was facing a massive onslaught of data scraping bots. These malicious actors were deploying bots and scrapers to harvest the data that Investing.com pays financial exchanges to publish. The company was dealing with 30-40 million content scraper requests per week that they needed to stop. As an advertising-supported business, the theft of this data was not only a breach of security but also a significant financial drain.
About The Customer
Investing.com is a leading global financial portal and internet brand that provides a wide range of financial information and tools. The company offers 30 editions in 22 languages and mobile apps for Android and iOS. Each edition covers a broad variety of local and global financial vehicles including stocks, bonds, commodities, currencies, interest rates, futures, and options. Investing.com is ranked 532 in Alexa Global Rank and is one of the top three financial portals in the world. The company operates on an advertising-supported business model, paying financial exchanges for financial markets data and content to publish to its user base.
The Solution
Investing.com turned to Signal Sciences for a solution. Signal Sciences provided an application and API defense solution, with agents installed on-premise in Investing.com's data center. They also utilized Signal Sciences Power Rules that detect and block bots and scrapers from harvesting content. Investing.com’s operations staff installed Signal Sciences agents on their highest traffic site web servers. Within the first week of putting these Power Rules in place, Signal Sciences blocked over 40 million bot requests without a single false positive. The solution also enabled Investing.com to meet European GDPR privacy requirements while protecting customer data. Signal Sciences' ability to deploy in any environment—on-premise, in the cloud, or hybrid environments—made the rollout easy and future-proof.
Operational Impact
Quantitative Benefit
Related Case Studies.
Case Study
Hydro One Leads the Way In Smart Meter Development
In 2010, Ontario’s energy board mandated that time-of-use (TOU) pricing for consumers be available for all consumers on a regulated price plan. To meet this requirement, Hydro One needed to quickly deploy a smart meter and intelligent communications network solution to meet the provincial government’s requirement at a low cost. The network needed to cover Hydro One’s expansive service territory, which has a land mass twice the size of Texas, and its customers live in a mix of urban, rural, and remote areas, some places only accessible by air, rail, boat or snowmobile. Most importantly, the network needed to enable future enterprise-wide business efficiencies, modernization of distribution infrastructure and enhanced customer service. To meet these needs, Hydro One conceptualized an end-to-end solution leveraging open standards and Internet Protocols (IP) at all communication levels. The utility drew upon industry leaders like Trilliant to realize this vision.
Case Study
Selling more with Whirlpool
Whirlpool wanted to add connectivity to appliances and transform the company's relationship with customers. Traditionally, Whirlpool interaction with customers was limited to purchases made once every ten years. Connected washer and dryers provide exciting new features like remote management of start times and inter-machine communication.
Case Study
SAS® Analytics for IoT: Smart Grid
Companies face falling revenues, rising infrastructure costs, and increasing risk of outages caused by inconsistent energy production from renewable sources. Less money is coming in as more people and organizations take steps to curb their energy use. Utilities are paying more to maintain and build infrastructure due to increasing complexity, resulting from the rising number of intermittent and variable renewable energy sources connected in the distribution grid.
Case Study
Enel Secures Italian Power Generation Network
Electric energy operators around the world are working to increase the reliability and cyber resiliency of their systems. This includes Enel, a global power company that manages and monitors the Italian power grid. This grid:• Serves 31 million customers• Has a net installed energy capacity exceeding 31 gigawatts• Includes more than 500 power generation plants,including hydroelectric, thermoelectric, and wind• Is managed and monitored by Enel 24/7/365• Is operated by Terna, the Italian Transmission System Operator (TSO)Enel is responsible for the availability of the grid’s underlying ICS and industrial network. It also manages Regional Control Centers and Interconnection Centers which connect with the TSO. The TSO manages the flow of energy to the grid plus controls and remotely regulates the power generation of power plants, increasing and decreasing power production as required. The complex system of interaction and cooperation between Enel and the TSO has strong security implications as well as operational and business challenges.
Case Study
IoT based Energy Quality Availability Monitoring Solution
There were several challenges faced:Since this data would be in the public domain, accuracy and authenticity of this data were of paramount importance. It should be able to withstand scrutiny.It is challenging to build an appliance that can withstand a wide range of voltage fluctuations from as low at 90v to as high as 320v. Since the device would be installed in remote locations, its resilience was of paramount importance.The device would have to deal with poor network coverage and have the ability to store and re-transmit data if networks were not available, which is often the case in rural India. The device could store up to 30 days of data.The platform that deals with the data should be readily available and highly reliable and never lose a packet of data.
Case Study
Data Capture for Afghanistan Forces
Electronic equipments on the field of Afghanistan provided information on the status of the vehicle and to identify potential threats surrounding it to the British Force. The monitoring and interpretation of this data requires robust and sophisticated digitization for data capture and communication.