Close Menu
    Facebook LinkedIn YouTube WhatsApp X (Twitter) Pinterest
    Trending
    • A reality check on the AI jobs hysteria
    • Carbon negative homes blueprint affordable sustainable living
    • Sam Altman thinks using AI in emails and Slack is ‘dehumanising’ – and revenue will ‘take a bit longer to figure out’
    • The Cookware Industry Has a Major Fight Brewing Over PFAS Claims
    • Best DIY Home Security Systems of 2026: Installed and Tested
    • It’s time to address the looming crisis in entry-level work.
    • China opens first robot training school for humanoids
    • Nearly everything we use online is owned by big tech – here’s why we need to reclaim our digital sovereignty
    Facebook LinkedIn WhatsApp
    Times FeaturedTimes Featured
    Tuesday, May 26
    • Home
    • Founders
    • Startups
    • Technology
    • Profiles
    • Entrepreneurs
    • Leaders
    • Students
    • VC Funds
    • More
      • AI
      • Robotics
      • Industries
      • Global
    Times FeaturedTimes Featured
    Home»Startups»Policing the bots: How new rules could save the web from AI scrapers
    Startups

    Policing the bots: How new rules could save the web from AI scrapers

    Editor Times FeaturedBy Editor Times FeaturedMay 11, 2026No Comments6 Mins Read
    Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
    Share
    Facebook Twitter LinkedIn Pinterest Telegram Email WhatsApp Copy Link


    Australians are among the many most anxious in the world about synthetic intelligence (AI).

    This nervousness is pushed by fears AI is used to spread misinformation and rip-off folks, nervousness over job losses, and the actual fact AI corporations are training their models on others’ experience and inventive works with out compensation.

    AI corporations have used pirated books and articles, and routinely send bots across the web to systematically scrape content material for his or her fashions to study from. That content material might come from social media platforms similar to Reddit, college repositories of educational work, and authoritative publications like news outlets.

    Prior to now, on-line scraping was topic to a sort of detente. Though scraping might generally have been technically unlawful, it was wanted to make the web work. For example, with out scraping there would be no Google. Web site house owners have been OK with scraping as a result of it made their content material extra accessible, in accordance with the imaginative and prescient of the “open web”.

    Underneath these circumstances, scraping was managed by way of principles similar to respect, recognition, and reciprocity. Within the context of AI, these are actually faltering.

    A brand new on-line panorama

    Many information retailers are actually blocking web scrapers. Creators are choosing not to use certain platforms or are posting much less.

    Get the perfect of Startup Day by day straight to your inbox

    Need to know the newest in startup information? Subscribe to our day by day information and evaluation protection on what’s taking place to ANZ startups, traders and the broader ecosystem. And better of all, it is FREE!

    By persevering with, you comply with our Terms & Conditions and Privacy Policy.

    Obstacles are being put in place throughout the open net. When just some can afford to pay to entry information and knowledge, then democracy, scientific innovation and inventive communities are all harmed.

    Exceptions to copyright infringement, similar to fair dealing for research or study, have been legislated lengthy earlier than generative AI grew to become publicly accessible. These exceptions are not match for objective in an AI age.

    The Australian authorities has ruled out a brand new copyright exception for textual content and knowledge mining. This alerts a dedication to supporting Australia’s artistic industries, however leaves nice uncertainty about how artistic content material could be managed legally and at scale now that AI corporations are crawling the online.

    In response, the worldwide nonprofit Inventive Commons has proposed a brand new voluntary framework: CC Signals.

    Creative Commons licences permit creators to share content material and specify how it may be used. All licences require credit score to acknowledge the supply, however varied further restrictions could be utilized. Creators can ask others to not modify their work, or to not use it for industrial functions. For instance, The Dialog’s articles can be found for reuse beneath a CC BY-ND licence, which suggests they should be credited to the supply and should not be remixed, reworked, or constructed upon.


    Abstract of CC licences. Creative Commons

    How would CC Indicators work?

    The proposed CC Indicators framework lets creators determine if or how they need their materials for use by machines. It goals to strike a steadiness between accountable AI use and never stifling innovation, and relies on the rules of consent, compensation, and credit score.

    Simplistically, CC Indicators work by permitting a “declaring occasion” – similar to a information web site – to connect machine-readable directions to a physique of content material. These directions specify what combos of machine makes use of are permitted, and beneath what circumstances.

    CC Indicators are standardised, and each people and machines can perceive them.

    This proposal arrives at a second that carefully mirrors the early days of the online, when norms round automated entry (crawling and scraping) have been nonetheless being labored out in apply slightly than regulation.

    A helpful historic parallel is robots.txt, a easy file net hosts use to sign which elements of a website could be accessed by the bots that crawl the online and search for content material. It was by no means enforceable, however it grew to become broadly adopted as a result of it offered a transparent, standardised strategy to talk expectations between content material hosts and builders.

    CC Indicators might function in a lot the identical spirit. However, as with every system, it has potential advantages in addition to drawbacks.

    The professionals

    The framework gives extra nuance and suppleness than the present scrape/don’t scrape atmosphere we’re in. It affords creators extra management over the usage of their content material.

    It additionally has the potential to have an effect on how a lot high-quality content material is on the market for scraping. With out entry to high-quality knowledge, AI’s biases are exacerbated and make the technology less useful.

    The framework may also profit smaller gamers who don’t have the bargaining energy to negotiate with big tech companies however who, nonetheless, need remuneration, credit score, or visibility for his or her work.

    The cons

    The best problem with CC Indicators is prone to be a sensible one – how one can calculate, after which implement, the financial or in-kind help required by among the alerts.

    That is additionally a serious sticking level with content material business proposals for collective licensing schemes for AI. Calculating and distributing licence charges for the hundreds, if not hundreds of thousands, of web works which might be accessed by generative AI methods all over the world is a logistical nightmare.

    Inventive Commons has said it plans to provide best-practice guides for how one can make a contribution and provides credit score beneath the CC Indicators. However this work remains to be in progress.

    The place to from right here?

    Inventive Commons asserts that the CC Indicators framework will not be a lot a authorized instrument as an try to outline “manners for machines”. Manners is an efficient manner to have a look at this.

    The authorized and sensible hurdles to implementing efficient copyright administration for AI methods are large. However we needs to be open to new concepts and frameworks that foreground respect and recognition for creators with out shutting down vital technological developments.

    CC Indicators is an imperfect framework, however it’s a begin. Hopefully there are extra to come back.

    • T.J. Thomson, Affiliate Professor of Visible Communication & Digital Media, RMIT University; Daniel Angus, Professor of Digital Communication, Director of QUT Digital Media Analysis Centre, Queensland University of Technology; Jake Goldenfein, Affiliate Professor, Melbourne Regulation Faculty, The University of Melbourne, and Kylie Pappalardo, Affiliate Professor, Faculty of Regulation, Queensland University of Technology

    This text is republished from The Conversation beneath a Inventive Commons license. Learn the original article.



    Source link

    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    Editor Times Featured
    • Website

    Related Posts

    Sam Altman thinks using AI in emails and Slack is ‘dehumanising’ – and revenue will ‘take a bit longer to figure out’

    May 26, 2026

    Nearly everything we use online is owned by big tech – here’s why we need to reclaim our digital sovereignty

    May 26, 2026

    Ignore the political spot fires, the bigger issue is where the bloody hell is Australia’s innovation strategy?

    May 26, 2026

    Founders, you’re losing the room with the current responses to capital gains tax changes

    May 26, 2026

    Tequipy, founded by Revolut’s former IT chief, raises over €3 million to automate global device logistics

    May 25, 2026

    Perplant raises €1 million to equip tractors with AI “eyes” to cut herbicide use and boost profits for farmers

    May 25, 2026

    Comments are closed.

    Editors Picks

    A reality check on the AI jobs hysteria

    May 26, 2026

    Carbon negative homes blueprint affordable sustainable living

    May 26, 2026

    Sam Altman thinks using AI in emails and Slack is ‘dehumanising’ – and revenue will ‘take a bit longer to figure out’

    May 26, 2026

    The Cookware Industry Has a Major Fight Brewing Over PFAS Claims

    May 26, 2026
    Categories
    • Founders
    • Startups
    • Technology
    • Profiles
    • Entrepreneurs
    • Leaders
    • Students
    • VC Funds
    About Us
    About Us

    Welcome to Times Featured, an AI-driven entrepreneurship growth engine that is transforming the future of work, bridging the digital divide and encouraging younger community inclusion in the 4th Industrial Revolution, and nurturing new market leaders.

    Empowering the growth of profiles, leaders, entrepreneurs businesses, and startups on international landscape.

    Asia-Middle East-Europe-North America-Australia-Africa

    Facebook LinkedIn WhatsApp
    Featured Picks

    Arrests made in alleged illegal gambling operation with €25 million turnover

    December 6, 2025

    Social Links raises €2.6 million to enhance AI tools that detect fraud, scam messages and brand misinformation

    November 24, 2025

    iPhone 17 vs. iPhone 16: Should You Upgrade?

    April 16, 2026
    Categories
    • Founders
    • Startups
    • Technology
    • Profiles
    • Entrepreneurs
    • Leaders
    • Students
    • VC Funds
    Copyright © 2024 Timesfeatured.com IP Limited. All Rights.
    • Privacy Policy
    • Disclaimer
    • Terms and Conditions
    • About us
    • Contact us

    Type above and press Enter to search. Press Esc to cancel.