Artificial Intelligence | News | Insights | AiThority
[bsfp-cryptocurrency style=”widget-18″ align=”marquee” columns=”6″ coins=”selected” coins-count=”6″ coins-selected=”BTC,ETH,XRP,LTC,EOS,ADA,XLM,NEO,LTC,EOS,XEM,DASH,USDT,BNB,QTUM,XVG,ONT,ZEC,STEEM” currency=”USD” title=”Cryptocurrency Widget” show_title=”0″ icon=”” scheme=”light” bs-show-desktop=”1″ bs-show-tablet=”1″ bs-show-phone=”1″ custom-css-class=”” custom-id=”” css=”.vc_custom_1523079266073{margin-bottom: 0px !important;padding-top: 0px !important;padding-bottom: 0px !important;}”]

Thwarting Digital Ad Fraud at Scale: An Open Source Experiment with Anomaly Detection

Ad fraud continues to be a thorn in the side of digital advertisers, as bot traffic and fraudulent human activity falsely inflate ad statistics. Such activity forces unwitting brands to shell out for clicks or impressions that have no hope of reaching – let alone converting – potential customers. A recent study by White Ops and the Association of National Advertisers (ANA) finds that advertisers lost around $5.8 billion to ad fraud last year. On the brighter side, the study also found that efforts to defeat ad fraud – using techniques such as Anomaly Detection – are now more successful than ever. In fact, ad fraud would have amounted to advertiser losses of more than $14 billion in 2018 if not for improved anti-fraud initiatives. While the study estimates that digital ad fraud attempts currently represent somewhere in the neighborhood of 20-35% of all ad impressions, the amount that gets through (and which advertisers actually pay for) is significantly smaller due to improved mitigation.

Read More: The Importance of AI in an Omnichannel CX Strategy – and How to Make It Work for Your Business

But there remains a long way to go, and one of the most widespread sources of digital ad fraud remains non-human traffic. As a rising practice, bad actors enlist botnets to execute fraud by directing an army of connected devices to visit sites and peck away at ads. In other cases, real humans use click farms to receive compensation for producing clicks and impressions with no intention of considering the ad content.

Still, other ad fraud scenarios involve non-viewable ads or ads which honest users cannot interact with correctly, such as ads that are unable to be closed. Importantly, in each of these ad fraud varieties, anomalous data is produced that Anomaly Detection systems can recognize in order to impede fraud and protect advertisers’ bottom lines.

All that said, the vast scale of advertising data generated through websites and ad networks adds a monumental data challenge to the task of implementing an ad fraud Anomaly Detection system – requiring appropriate computational, scalability, and performance capabilities. Instaclustr, the company I work for, doesn’t sell ad fraud solutions but we recently completed a purely experimental Anomaly Detection application that shows how scalable Open source technologies might be able to spare advertisers from the costs and harm of ad fraud.

Related Posts
1 of 651

To achieve the requisite capabilities while keeping the experimental solution cost-effective for practical usage, our test system used an architecture comprised of open source Apache Kafka, Apache Cassandra, and our Anomaly Detection application. Beyond the performance, scalability, and affordably Kafka and Cassandra provide, both Open-source data technologies also offer a particularly high degree of compatibility and pair well together.

Our experiment assembles Kafka, Cassandra, and our Anomaly Detection application in a Lambda architecture, in which Kafka and our streaming data pipeline are the speed layer, and Cassandra acts as the batch and serving layer. In this configuration, Kafka makes it possible to ingest streaming digital ad data in a fast and scalable manner, while taking a “store and forward” approach so that Kafka can serve as a buffer to protect the Cassandra database from being overwhelmed by major data surges. Cassandra’s strength is in storing high-velocity streams of ad metric data in its linearly scalable, write-optimized database. In order to handle automation for provisioning, deploying, and scaling the application, the Anomaly Detection experiment relies on Kubernetes on AWS EKS.

In the end, the experiment was a successful one. The Anomaly Detection application has demonstrated the ability to process 19 billion real-time data events in a day, likely meeting the ad fraud detection needs of even the largest brands. To reach these results, we scaled the application from an initial three Cassandra nodes all the way out to 48. At the same time, the experiment made use of 574 CPU cores, counting all Cassandra, Kafka, and Kubernetes clusters. The experimental application proved capable of maintaining a peak 2.3 million writes per second into Kafka, amounting to a sustainable 220,000 anomaly checks every second.

By teaming Open-source data-layer technologies like Kafka and Cassandra and making the most of the intrinsic benefits each has to offer, this experiment demonstrates a successful method for advertisers and ad networks to use for their own needs – a path for affordable, scalable, high performance Anomaly Detection applications that ensure the integrity of the ad metrics they pay good money to achieve.

Read More: Email Marketing Isn’t Dying, It’s Already Dead

42 Comments
  1. Yaşlı Cin porno izle says

    Explore what money is and what we use it for. Once you understand the benefits and disadvantages of money, you can understand
    why it's so important.

  2. kate mara azgın porno says

    Xxx vajina porno resimleri ve gençler ve mılfs seksi amcık resimleri.
    pornosu; Galeriler. En Ateşli; En Yeni; Türkçe.
    English; Deutsch; Français; Italiano; Fisting resimleri. Kot pantolon porno resimler.
    Amatör Porno fotoğraf. Puma. Duş seks fotoğrafları.

  3. bedava orospu şikiş says

    ErosBerry, 2011 yılında kurulan ve ücretsiz seks filmlerinin yanı sıra tanınmış modeller ve porno yıldızlarından oluşan fotoğraf galerilerinin bulunduğu bir.

  4. What’s the best way to obtain Metformin without
    a pesky prescription getting in the way? Buy Metformin online
    without prescription
    Can I buy Metformin without prescription? how to buy prescription drugs without a prescription

  5. baccaratcommunity says

    Looking at this article, I miss the time when I didn’t wear a mask. baccaratcommunity Hopefully this corona will end soon. My blog is a blog that mainly posts pictures of daily life before Corona and landscapes at that time. If you want to remember that time again, please visit us.

  6. Eco-friendly metal recycling Ferrous material recycling unit Iron recycling and reusing

    Ferrous metal reclamation, Iron scrap salvage yard, Scrap metal recovery and reclamation yard

  7. Copper scrap profit margin says

    Copper scrap prices today Copper scrap crisis response Scrap metal reclamation plants
    Copper cable refining, Scrap metal export, Copper scrap risk management

  8. SusanNut says

    I recently tried [url=https://www.cornbreadhemp.com/collections/full-spectrum-cbd-oil ]cbd oil organic[/url] after the prime control and was pleasantly surprised past the results. Initially skeptical, I found that it significantly helped with my desire and sleep issues without any unconcealed side effects. The oil was serene to utter, with legible dosage instructions. It had a indulgent, lusty leaning that was not unpleasant. Within a week, I noticed a marked convalescence in my total well-being, instinct more serene and rested. I know the natural approximate to wellness CBD offers and representation to at using it.

  9. Mikiyu says

    Money management when playing slot games is extremely important. Because it can help you enjoy sustainable gameplay without worrying about losing money in the long run. One of the best ways to manage money is to set a limit for each bet and set a goal for how much profit you want to make yourself each day or week. Playing slots mindfully requires controlling your emotions and making conscious decisions. This will improve your chances of winning and reduce your risk of losing money in the long run. The more you plan and control your bets, the better. Slot games will eventually become more fun and profitable!
    In addition, choosing the right pg slot game for playing is also important. Start by choosing a game with a high payout rate that is interesting to you. Keep in mind that there is no specific strategy or formula that can make you a sure-fire winner at slot games. But choosing the right games and managing your money rationally will increase your chances of winning.
    Also, don’t forget to pay attention to the time you spend playing slot games. It is important to control and limit play time. This is to prevent any missed work or regulatory violations that may occur due to playing too many slot games.
    Finally, remember that playing slot games should just be fun and an interesting activity. Don’t let it become your only dependency or lack of happiness. Game play should be enjoyed mindfully and there should always be no injustice in handling money. Self-control is the most important thing in playing slot games and in everything. Issues related to online g*******

  10. wrtr0er says

    “Preventing digital ad fraud at scale” is an important topic in today’s digital marketing field. The open source experiment of anomaly detection provides an innovative solution to this problem. In this process, Telegram, as an efficient communication tool, can help research teams and developers share experimental results and technical details in real time. By setting up a dedicated discussion group or channel on Telegram中文, participants can quickly obtain the latest experimental progress, discuss the effectiveness of detection algorithms, and solve technical problems in a timely manner. This instant information exchange will help speed up the research process and improve experimental results.

  11. wreplay0er says

    In the field of digital advertising fraud prevention, open source experiments are crucial, and Telegram, as a modern communication tool, can play an important role in this process. Through Telegram, team members can share the latest progress of data anomaly detection in real time, discuss different detection methods, and quickly respond to feedback from the community. Telegram中文版‘s group and channel functions provide participants with a centralized communication platform, making information flow more efficient, thereby promoting the continuous advancement and optimization of technology.

  12. wrepltrer says

    Prevention of digital ad fraud requires continuous technological innovation and collaboration. Open source experiments have brought new hope to this field, and Telegram can serve as an important tool for collaboration and information sharing. When conducting anomaly detection experiments, Telegram can help researchers and developers update experimental progress in real time, share best practices, and discuss algorithm optimization solutions. By creating a dedicated Telegram apk channel, the project team can effectively coordinate work, ensure the smooth progress of experiments, and quickly respond to possible problems.

  13. Reply ftre says

    The open source experiment of “Preventing Digital Ad Fraud at Scale” demonstrates cutting-edge innovation in the field of technology. Telegram cn can play a vital role in this process. Using Telegram’s instant messaging and discussion features, the research team can quickly exchange insights and feedback on anomaly detection algorithms. In addition, Telegram can also help organize online seminars and technical sharing sessions, so that more industry experts and developers can participate in experimental discussions and jointly promote the development of digital ad fraud prevention technology.

  14. Anonymous says

    Telegram中文版 provides an ideal platform for discussing innovations in digital advertising. The open-source experiment on anomaly detection in ad fraud is a timely topic, and sharing insights in dedicated Telegram groups could enhance collaborative efforts to combat this issue at scale.

  15. TG CN says

    Telegram中文 enhances the exploration of destinations like Kariandusi by allowing travelers to exchange photos and recommendations in real-time. This community aspect can truly enrich the experience, providing a space for lively discussions and shared adventures.

  16. brookebelinda940 says

    การเล่นสล็อตเว็บตรงเป็นกิจกรรมที่ได้รับความนิยม แต่เช่นเดียวกับการพนันรูปแบบอื่นๆ ก็มีความเสี่ยงที่ต้องระมัดระวังในการเลือกใช้บริการเพื่อป้องกันตนเองจากการถูกโกง นี่คือข้อควรระวังที่ควรคำนึงถึงเลือกเว็บที่มีใบอนุญาตถูกต้อง การเลือกเล่น มีตังค์168 สล็อต ออนไลน์ผ่านเว็บที่ได้รับใบอนุญาตจากหน่วยงานควบคุมการเล่น จะช่วยให้มั่นใจได้ว่าเว็บไซต์นั้นปฏิบัติตามกฎระเบียบที่เข้มงวดและมีความน่าเชื่อถือ เว็บที่มีการรับรองอย่างถูกต้องมักจะโปร่งใสในเรื่องการทำงานและการจ่ายเงินรางวัล ตรวจสอบรีวิวและความเห็นของผู้ใช้ การค้นหาข้อมูลและตรวจสอบรีวิวจากผู้ใช้งานคนอื่นๆ จะช่วยให้คุณเห็นภาพรวมของความน่าเชื่อถือของเว็บไซต์ โดยเฉพาะเว็บที่มีการรีวิวดีจากหลายแหล่งจะเป็นเครื่องมือช่วยในการตัดสินใจได้

  17. Yindee says

    การเสริมดวงในการเล่นเกมสล็อตออนไลน์เป็นเรื่องที่หลายคนสนใจ เนื่องจากการเล่นเกม เศรษฐี777สล็อต ในลักษณะนี้อาจเกี่ยวข้องกับโชคชะตาและความเชื่อส่วนบุคคล การเสริมดวงอาจถูกมองว่าเป็นวิธีในการเพิ่มโอกาสหรือนำโชคมาสู่ตัวเอง แต่ก็ต้องเข้าใจว่าเกมสล็อตออนไลน์เป็นเกมที่ใช้ระบบสุ่ม (RNG) ซึ่งควบคุมโดยโปรแกรมคอมพิวเตอร์ ไม่มีวิธีการใด ๆ ที่จะสามารถเปลี่ยนแปลงผลลัพธ์ของเกมได้โดยตรง อย่างไรก็ตาม ความเชื่อในเรื่องการเสริมดวงหรือการปฏิบัติตัวตามหลักฮวงจุ้ย เลขศาสตร์ หรือการใช้เครื่องรางของขลัง อาจช่วยให้ผู้เล่นมีความมั่นใจและรู้สึกดีขึ้นในระหว่างการเล่น

  18. KennethCip says

    rybpharm: rybpharm cheap semaglutide – rybpharm

  19. CurtisCough says

    ED pills non prescription [url=http://erepharm.com/#]ED meds online with insurance[/url] best ed pill ere pharm

  20. LloydGes says

    https://gabapharm.com/# buy Gabapentin GabaPharm

  21. Dennishox says

    ED meds online with insurance: best ed pill ere pharm – best ed pill ere pharm

  22. CurtisCough says

    buy kamagra oral jelly Kam Pharm [url=http://kampharm.shop/#]Kam Pharm[/url] Kam Pharm

  23. RobertVag says

    erepharm pills: ere pharm – ED meds online

  24. Glennblope says

    ed pills online pharmacy [url=http://canadiandrugsgate.com/#]Best Canadian online pharmacy[/url] natural remedies for ed

  25. JefferyImick says

    reputable indian pharmacies: indianpharmacyeasy – Online medicine home delivery

  26. JefferyImick says

    purple pharmacy mexico price list: medicines mexico rx online – mexico drug stores pharmacies

  27. JefferyImick says

    medication from mexico pharmacy: mexican drugstore online – mexican rx online

  28. Glennblope says

    online canadian drugstore [url=https://canadiandrugsgate.com/#]Canada pharmacy online[/url] drug prices

  29. Jamiecotte says

    http://indianpharmacyeasy.com/# india pharmacy mail order

  30. Larrylef says

    buying prescription drugs in mexico: mexican drugstore online – reputable mexican pharmacies online

  31. Glennblope says

    reputable indian pharmacies [url=https://indianpharmacyeasy.com/#]indian pharmacy[/url] top online pharmacy india

  32. Derekdrino says

    how to buy amoxicillin online: amoxil – amoxicillin 30 capsules price

  33. Brandenbed says

    order prednisone 10mg: ray pharm – prednisone 30

  34. DanielTon says

    amoxicillin online canada http://priligymaxpharm.com/# priligy maxpharm

  35. Bradleydat says

    amoxicillin 500 mg [url=http://amoxilcompharm.com/#]Com Pharm[/url] amoxicillin 200 mg tablet

  36. Stevenzef says

    where can i get amoxicillin 500 mg: Com Pharm – amoxicillin 500mg without prescription

  37. Bradleydat says

    can you buy prednisone over the counter [url=https://prednisoneraypharm.com/#]Prednisone Without Prescription[/url] can i buy prednisone over the counter in usa

  38. Derekdrino says

    cost clomid: clomid online – can you buy generic clomid price

  39. Stevenzef says

    buying prednisone without prescription: Prednisone Without Prescription – 50mg prednisone tablet

  40. Stevenzef says

    generic amoxicillin over the counter: Amoxicillin buy online – amoxicillin no prescipion

  41. Darrenmople says
  42. BernardPlofs says

    buy Clopidogrel over the counter [url=https://plavixclo.com/#]generic plavix[/url] antiplatelet drug

Leave A Reply

Your email address will not be published.