Co-author Mathieu Huot says he’s excited to see ADEV "used as a design space for novel low-variance estimators, a key challenge in probabilistic computations." In addition to climate modeling and financial modeling, ADEV could also be used for operations research - for example, simulating customer queues for call centers to minimize expected wait times, by simulating the wait processes and evaluating the quality of outcomes - or for tuning the algorithm that a robot uses to grasp physical objects. ADEV brings the benefits of probabilistic programming - automated math and more scalable inference algorithms - to a much broader range of problems where the goal is not just to infer what is probably true but to decide what action to take next." ADEV presents such a foundation for modular and compositional probabilistic inference with derivatives. Sasa Misailovic, an associate professor at the University of Illinois at Urbana-Champaign who was not involved in this research, adds: "As the probabilistic programming paradigm is emerging to solve various problems in science and engineering, questions arise on how we can make efficient software implementations built on solid mathematical principles. My hope is that by providing a framework for building these estimators automatically, ADEV will make it more attractive to experiment with probabilistic models, possibly enabling new discoveries and advances in AI and beyond.” But probability is an incredibly useful tool for modeling the world. “The need to derive low-variance, unbiased gradient estimators by hand can lead to a perception that probabilistic models are trickier or more finicky to work with than deterministic ones. Lead author and MIT electrical engineering and computer science PhD student Alex Lew says he hopes people will be less wary of using probabilistic models now that there’s a tool to automatically differentiate them. This brings the benefits of AI programming to a much broader class of problems, enabling rapid experimentation with models that can reason about uncertain situations. To fix this problem, MIT researchers developed ADEV, which extends automatic differentiation to handle models that make random choices. If you try to use deep learning platforms on these problems, they can easily give the wrong answer. Instead, it's defined by a stochastic model that makes random choices to model unknowns. The "score" is no longer just a deterministic function of the parameters. This allowed researchers to rapidly explore a huge space of models, and find the ones that really worked, without needing to know the underlying math.īut what about problems like climate modeling, or financial planning, where the underlying scenarios are fundamentally uncertain? For these problems, calculus alone is not enough - you also need probability theory. Deep learning platforms use a method called automatic differentiation to calculate the adjustments automatically. The equations used to adjust the parameters in each tuning step used to be derived painstakingly by hand. Neural networks are trained by tuning their parameters to try to maximize a score that can be rapidly calculated for training data. and to engage in critical conversations that urge educators to create structures where each and every student can be fully engaged in our democratic society.One reason deep learning exploded over the last decade was the availability of programming languages that could automate the math - college-level calculus - that is needed to train each new model.to stand up when we see racial injustice and understand our own implicit biases and how they affect our students and colleagues,.to listen to and support our Black colleagues and students,.to reaffirm our commitment to be an inclusive community,.We urge all to heed the calls made by our professional societies, including (but not limited to) the following: The Department of Mathematical Sciences at UW-Milwaukee stands in solidarity with Black and underrepresented minority fellow employees, students, and community members.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |