PDF] Reproducibility via Crowdsourced Reverse Engineering: A Neural Network Case Study With DeepMind's Alpha Zero

The significant success of reverse-engineering the important accomplishments of DeepMind's Alpha Zero exemplifies the leverage that can be achieved by a concerted effort to reproduce results. The reproducibility of scientific findings are an important hallmark of quality and integrity in research. The scientific method requires hypotheses to be subjected to the most crucial tests, and for the results to be consistent across independent trials. Therefore, a publication is expected to provide sufficient information for an objective evaluation of its methods and claims. This is particularly true for research supported by public funds, where transparency of findings are a form of return on public investment. Unfortunately, many publications fall short of this mark for various reasons, including unavoidable ones such as intellectual property protection and national security of the entity creating those findings. This is a particularly important and documented problem in medical research, and in machine learning. Fortunately for those seeking to overcome these difficulties, the internet makes it easier to share experiments, and allows for crowd-sourced reverse engineering. A case study of this capability in neural networks research is presented in this paper. The significant success of reverse-engineering the important accomplishments of DeepMind's Alpha Zero exemplifies the leverage that can be achieved by a concerted effort to reproduce results.

Machine Learning for Chemical Reactions

A survey on data‐efficient algorithms in big data era, Journal of Big Data

PDF) Evaluating AI systems under uncertain ground truth: a case study in dermatology

Machine Learning for Chemical Reactions

Science Cast

Challenges and Applications of Large Language Models: Desi GN Behavior, PDF, Computing

Artificial intelligence of things (AIoT) data acquisition based on graph neural networks: A systematical review - Wang - Concurrency and Computation: Practice and Experience - Wiley Online Library

GitHub - youngfish42/Awesome-FL: Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)

ICLR 2021

2023 ICICT Proceedings, PDF, Machine Learning

PDF) Simulation Intelligence: Towards a New Generation of Scientific Methods

Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery

ICLR 2021

Reproducibility via Crowdsourced Reverse Engineering: A Neural Network Case Study With DeepMind's Alpha Zero

10.1007@978 3 030 49161 1, PDF, Artificial Intelligence