Sunday, June 8, 2025
News PouroverAI
Visit PourOver.AI
No Result
View All Result
  • Home
  • AI Tech
  • Business
  • Blockchain
  • Data Science & ML
  • Cloud & Programming
  • Automation
  • Front-Tech
  • Marketing
  • Home
  • AI Tech
  • Business
  • Blockchain
  • Data Science & ML
  • Cloud & Programming
  • Automation
  • Front-Tech
  • Marketing
News PouroverAI
No Result
View All Result

This Machine Learning Research Develops an AI Model for Effectively Removing Biases in a Dataset

November 5, 2023
in AI Technology
Reading Time: 4 mins read
0 0
A A
0
Share on FacebookShare on Twitter


Data collecting might be a prime opportunity for the unintended introduction of texture biases. When a model is trained on biased data and then applied to out-of-distribution data, the performance often drops dramatically since the source and nature of the biases need to be clarified. The literature is rich with research aimed at reducing or eliminating prejudice. Prior research proposed to extract bias-independent features through adversarial learning, enabling the model to solve the intended classification task without relying on biased data. However, since it is challenging to decouple biased features through adversarial learning entirely, texture-based representations are commonly retained after training. 

A team from Daegu Gyeongbuk Institute of Science and Technology (DGIST) has created a new image translation model that has the potential to lessen data biases significantly. When building an AI model from scratch from a collection of photos from multiple sources, data biases may exist despite the user’s best efforts to avoid them. High image-analysis performance is achieved thanks to the created model’s ability to eliminate data biases without knowledge about such aspects. Developments in autonomous vehicles, content creation, and healthcare would all benefit from this solution.

Deep learning models are often trained on biased datasets. For example, when developing a dataset to identify bacterial pneumonia from coronavirus disease 2019 (COVID-19), picture collection circumstances may vary because of the possibility of COVID-19 infection. Consequently, these variances result in small differences in the images, causing existing deep-learning models to diagnose diseases based on attributes resulting from differences in image procedures rather than the key qualities for practical disease identification.

Using spatial self-similarity loss, texture co-occurrence, and GAN losses, we can generate high-quality images with the desired qualities, such as consistent content and similar local and global textures. After images are produced with the help of the training data, a debiased classifier or modified segmentation model can be learned. The most important contributions are as follows:

As an alternative, the team suggest using texture co-occurrence and spatial self-similarity losses to translate images. The image translation task is one for which these losses have never been studied in isolation from others. They demonstrate that optimal pictures for debiasing and domain adaptation can be obtained by optimizing both losses.

The team present a strategy for learning downstream tasks that effectively mitigates unexpected biases during training by enriching the training dataset explicitly without utilizing bias labels. Our approach is also independent of the segmentation module, which allows it to function with state-of-the-art segmentation tools. Our approach can efficiently adapt to these models and boost performance by enriching the training dataset.

The team demonstrated the superiority of our approach over state-of-the-art debiasing and domain adaptation techniques by comparing it to five biased datasets and two domain adaptation datasets and by generating high-quality images compared to previous image translation models.

The created deep learning model outperforms preexisting algorithms because it creates a dataset by applying texture debiasing and then uses that dataset to train.

It achieved superior performance compared to existing debiasing and image translation techniques when tested on datasets with texture biases, such as a classification dataset for distinguishing numbers, a classification dataset for determining dogs and cats with different hair colours, and a classification dataset applying other image protocols for distinguishing COVID-19 from bacterial pneumonia. It also performed better than prior methods on datasets that include biases, such as a classification dataset designed to differentiate between multi-label integers and one intended to differentiate between still photographs, GIFs, and animated GIFs.

Check out the Paper and Reference Article. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to join our 32k+ ML SubReddit, 40k+ Facebook Community, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.

If you like our work, you will love our newsletter..

We are also on Telegram and WhatsApp.

\"\"

Dhanshree Shenwai is a Computer Science Engineer and has a good experience in FinTech companies covering Financial, Cards & Payments and Banking domain with keen interest in applications of AI. She is enthusiastic about exploring new technologies and advancements in today’s evolving world making everyone\’s life easy.

🔥 Meet Retouch4me: A Family of Artificial Intelligence-Powered Plug-Ins for Photography Retouching



Source link

Tags: BiasesDatasetDevelopsEffectivelyLearningMachinemodelRemovingResearch
Previous Post

Diffusion Models: How do They Diffuse? | by Onur Yuce Gun, PhD | Nov, 2023

Next Post

Top 5 programming language of 2023 | Hindi

Related Posts

How insurance companies can use synthetic data to fight bias
AI Technology

How insurance companies can use synthetic data to fight bias

June 10, 2024
From Low-Level to High-Level Tasks: Scaling Fine-Tuning with the ANDROIDCONTROL Dataset
AI Technology

From Low-Level to High-Level Tasks: Scaling Fine-Tuning with the ANDROIDCONTROL Dataset

June 10, 2024
Decoding Decoder-Only Transformers: Insights from Google DeepMind’s Paper
AI Technology

Decoding Decoder-Only Transformers: Insights from Google DeepMind’s Paper

June 9, 2024
How Game Theory Can Make AI More Reliable
AI Technology

How Game Theory Can Make AI More Reliable

June 9, 2024
Buffer of Thoughts (BoT): A Novel Thought-Augmented Reasoning AI Approach for Enhancing Accuracy, Efficiency, and Robustness of LLMs
AI Technology

Buffer of Thoughts (BoT): A Novel Thought-Augmented Reasoning AI Approach for Enhancing Accuracy, Efficiency, and Robustness of LLMs

June 9, 2024
Deciphering Doubt: Navigating Uncertainty in LLM Responses
AI Technology

Deciphering Doubt: Navigating Uncertainty in LLM Responses

June 9, 2024
Next Post
Top 5 programming language of 2023 | Hindi

Top 5 programming language of 2023 | Hindi

First Trade: Zee Business Live | Share Market Live Updates | Stock Market News | 10th October 2023

First Trade: Zee Business Live | Share Market Live Updates | Stock Market News | 10th October 2023

G20 Summit 2023: India’s G20 Presidency Advances Global Consensus on Crypto Assets Regulation

G20 Summit 2023: India's G20 Presidency Advances Global Consensus on Crypto Assets Regulation

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

  • Trending
  • Comments
  • Latest
23 Plagiarism Facts and Statistics to Analyze Latest Trends

23 Plagiarism Facts and Statistics to Analyze Latest Trends

June 4, 2024
Accenture creates a regulatory document authoring solution using AWS generative AI services

Accenture creates a regulatory document authoring solution using AWS generative AI services

February 6, 2024
Managing PDFs in Node.js with pdf-lib

Managing PDFs in Node.js with pdf-lib

November 16, 2023
Graph neural networks in TensorFlow – Google Research Blog

Graph neural networks in TensorFlow – Google Research Blog

February 6, 2024
13 Best Books, Courses and Communities for Learning React — SitePoint

13 Best Books, Courses and Communities for Learning React — SitePoint

February 4, 2024
From Low-Level to High-Level Tasks: Scaling Fine-Tuning with the ANDROIDCONTROL Dataset

From Low-Level to High-Level Tasks: Scaling Fine-Tuning with the ANDROIDCONTROL Dataset

June 10, 2024
Can You Guess What Percentage Of Their Wealth The Rich Keep In Cash?

Can You Guess What Percentage Of Their Wealth The Rich Keep In Cash?

June 10, 2024
AI Compared: Which Assistant Is the Best?

AI Compared: Which Assistant Is the Best?

June 10, 2024
How insurance companies can use synthetic data to fight bias

How insurance companies can use synthetic data to fight bias

June 10, 2024
5 SLA metrics you should be monitoring

5 SLA metrics you should be monitoring

June 10, 2024
From Low-Level to High-Level Tasks: Scaling Fine-Tuning with the ANDROIDCONTROL Dataset

From Low-Level to High-Level Tasks: Scaling Fine-Tuning with the ANDROIDCONTROL Dataset

June 10, 2024
UGRO Capital: Targeting to hit milestone of Rs 20,000 cr loan book in 8-10 quarters: Shachindra Nath

UGRO Capital: Targeting to hit milestone of Rs 20,000 cr loan book in 8-10 quarters: Shachindra Nath

June 10, 2024
Facebook Twitter LinkedIn Pinterest RSS
News PouroverAI

The latest news and updates about the AI Technology and Latest Tech Updates around the world... PouroverAI keeps you in the loop.

CATEGORIES

  • AI Technology
  • Automation
  • Blockchain
  • Business
  • Cloud & Programming
  • Data Science & ML
  • Digital Marketing
  • Front-Tech
  • Uncategorized

SITEMAP

  • Disclaimer
  • Privacy Policy
  • DMCA
  • Cookie Privacy Policy
  • Terms and Conditions
  • Contact us

Copyright © 2023 PouroverAI News.
PouroverAI News

No Result
View All Result
  • Home
  • AI Tech
  • Business
  • Blockchain
  • Data Science & ML
  • Cloud & Programming
  • Automation
  • Front-Tech
  • Marketing

Copyright © 2023 PouroverAI News.
PouroverAI News

Welcome Back!

Login to your account below

Forgotten Password? Sign Up

Create New Account!

Fill the forms bellow to register

All fields are required. Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In