skip to main content
Article Podcast Report Summary Quick Look Video Newsfeed triangle plus sign dropdown arrow Case Study All Search Facebook LinkedIn YouTube

Search Results

Your search for Assessment found 200 results.

ai with ai: Poetein Folding
/our-media/podcasts/ai-with-ai/season-4/4-10
In COVID-related AI news, Andy and Dave discuss a Facebook model that provides county-level forecasts on the spread of COVID-19. IN non-COVID AI news, DeepMind’s AlphaFold 2 won the 14th biennial Critical Assessment of Structure Prediction (CASP), scoring above 90 on a global distance test for around two-thirds of the test proteins. Partnership on AI establishes The AI Incident Database (AIID) to provide an open-access resource on failures of AI systems, currently containing over 1,000 publically available “incident reports.” CSET publishes a report on ‘”Cool Projects” or “Expanding the Efficiency of the Murderous American War Machine?”’ which examines the perspectives of US AI industry professional toward working on Department of Defense funded AI projects. The UN, in conjunction with Trend Micro Research and the European Cybercrime Centre, releases a report on Malicious Uses and Abuses of AI, which highlights the potential physical impacts of hackers on autonomous- and AI-related technologies. And LtGen Michael Groen, the new Director of the Joint AI Center, provides an overview of the JAIC’s goals and objectives. In research, NVidia, Rice University, and Caltech publish the BONGARD-LOGO benchmark set, as an expansion of the Bongard Problems, which provide free-form shape concepts to test context-dependent perception, analogy-making perception, and perception with few samples. Joshua C. Gellers provides the book of the week, examining the case for Rights for Robots. And Google AI releases Verse by Verse, which draws upon the writings of various poets to help users generate their own poems, of which Andy and Dave both share examples.
In COVID-related AI news, Andy and Dave discuss a Facebook model that provides county-level forecasts on the spread of COVID-19. IN non-COVID AI news, DeepMind’s AlphaFold 2 won the 14th biennial Critical Assessment of Structure Prediction (CASP), scoring above 90 on a global distance test for around two-thirds of the test proteins. Partnership on AI establishes The AI Incident Database (AIID) to provide an open-access resource on failures of AI systems, currently containing over 1,000 publically available “incident reports.” CSET publishes a report on ‘”Cool Projects” or “Expanding
ai with ai: CONSORTing with the GPT
/our-media/podcasts/ai-with-ai/season-3/3-46
In COVID-related AI news, another concerning report, this time in Nature Medicine, found “serious concerns” with 20,000 studies on AI systems in clinical trials, with many reporting only the best-case scenarios; in response, an international consortium has developed CONSORT-AI, reporting guidelines for clinical trials involving AI. In Nature, an open dataset provides a collection and overview of governmental interventions in response to COVID-19. In regular AI news, the DoD wraps up its 2020 AI Symposium. And the White House nominates USMC Maj. Gen. Groen to lead the JAIC. The latest report from the NIST shows that facial recognition technology still struggles to identify people of color. Portland, Oregon passes the toughest ban on facial recognition technology in the US. And The Guardian uses GPT-3 to generate some hype. In research, OpenAI demonstrates the ability to apply transformer-based language models to the task of automated theorem proving. Research from Berkeley, Columbia, and Chicago proposes a new test to measure a text model’s multitask accuracy, with 16,000 multiple choice questions across 57 task areas. A report from AI Now takes a look at regulating biometrics, which includes tech such as facial recognition. And the 37th International Conference on Machine Learning makes its proceedings available online.
interventions in response to COVID-19 "External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms" Announcements / News -   "Just" AI
ai with ai: Life Is Like a Box of Matrices
/our-media/podcasts/ai-with-ai/season-3/3-38
Andy and Dave start with COVID-related AI news, and efforts from the Roche Data Science Coalition for UNCOVER (the United Network for COVID-19 Data Exploration and Research), which includes a dataset of a curated collection of over 200 publicly available COVID-19 related datasets; efforts from Akai Kaeru are included. The Biomedical Engineering Society publishes an overview of emerging technologies to combat COVID-19. Zetane Systems uses machine learning to search the DrugVirus database and information from the National Center for Biotechnology to identify existing drugs that might be effective against COVID. And researchers at the Walter Reed Army Institute of Research are using machine learning to narrow down a space of 41 million compounds to identify candidates for further testing. And the IEEE hosted a conference on 9 July, "Does your COVID-19 tracing app follow you forever?" In non-COVID-related AI news, MIT takes offline the TinyImages dataset, due to its inclusion of derogatory terms and images. The second (actually first) wrongful arrest from facial recognition technology (again by the Detroit Police Department) comes to light. Appen Limited releases its annual "State of AI and ML" report, with a look at how businesses are (or aren’t) considering AI technologies. Anaconda releases its 2020 State of Data Science survey results. And the International Baccalaureate Educational Foundation turn to machine learning algorithms to predict student grades, due to COVID-related cancelations of actual testing, and much to the frustration of numerous students and parents. Research from the Vector Institute and the University of Toronto tackles analogy and the Raven Progressive Matrices with an ensemble of three neural networks for objects, attributes, and relationships. Researchers at the University of Sydney and the Imperial College London have established CompEngine, a collection of time-series data (over 24,000 initially) from a variety of fields, and have placed them into a common feature space; CompEngine then self-organizes the information based on empirical properties. Garfinkel, Shevtsov, and Guo make Modeling Life available for free. Meanwhile, Russell and Norvig release the not-so-free 4th Edition of AI: A Modern Approach. Lex Fridman interviews Norvig in a video podcast. And Elias Henriksen creates the Computer Prophet, which generates metaphors from a database of collected sayings.
Video of "assessment" process An extended discussion Research of the Week Discovering Objects, Attributes, Relationships in Analogical Reasoning Technical paper Project homepage
ai with ai: The Final Sunbrawler
/our-media/podcasts/ai-with-ai/season-3/3-17
Andy and Dave discuss the recent announcement that the U.S. Department of Defense announces that it will adopt the Defense Innovation Board’s detailed principles for using AI. The European Commission releases its white paper on AI. The University of Buffalo’s AI Institute receives a grant to study gamers’ brains in order to build AI military robots. Microsoft announces Turing-NLG, a 17-billion parameter language model. MIT’s CSAIL demonstrates TextFooler, which makes synonym-like substitutions of words, the results of which can severely degrade the accuracy of NLP classifiers. Researchers from McAfee show simple tricks to fool Tesla’s Mobileye EyeQ3 camera. And Andy and Dave conclude with a discussion with Professor Josh Bongard, from the University of Vermont, on his recent “xenobots” research.
into accelerating by 50 miles per hour Summary McAfee’s technical assessment Xenobots – interview with Josh Bongard, co-author of “A Scalable pipeline for designing reconfigurable orgamisms
ai with ai: Gremlin Pie!
/our-media/podcasts/ai-with-ai/season-3/3-14
Happy Pi-cast! Andy and Dave discuss some of the stories that have followed the New York Times articles on Clearview AI, to include Twitter telling the company to stop using its photos, and a consortium of 40 agencies calls on the U.S. government to ban facial recognition systems until more is known about the technology. Meanwhile, London’s Metropolitan Police is rolling out live facial recognition technology. BlueDot says that it used AI and its epidemiologists to send a warning about the Wuhan virus on 31 December 2019, a full week before the US CDC announcement on 6 January 2020. Google releases the largest high-resolution map of the fruit fly’s brain, with 25,000 neurons. DARPA’s Gremlin (X-61A) drone system makes its first test flight. And the Guinness Book of World Records recognizes Stephen Worswick as the most frequent winner (5 times) of the Loebner Prize, for his Mitsuku chatbot. In research, Facebook AI achieves near-perfect (99.9%) navigation without needing a map, testing its algorithm in its AI Habitat. Robert J. Marks makes The Case * for * Killer Robots. The Brookings Institute’s Indermit Gill predicts that the AI leader in 2030 will “rule the planet” until at least 2100. The ACT-IAC releases an AI Playbook, with step-by-step guidance for assessment, readiness, selection, implementation, and integration. Jessica Flack examines the Collective Computation of Reality in Nature and Society. Google’s Dataset Search is out of beta. And DoD will be holding its East Coast AI Symposium and Exposition 29 and 30 April in Crystal City.
at least 2100. The ACT-IAC releases an AI Playbook, with step-by-step guidance for assessment, readiness, selection, implementation, and integration. Jessica Flack examines the Collective Computation
ai with ai: From A to Z
/our-media/podcasts/ai-with-ai/season-2/2.42
Two special guests join Andy and Dave for a discussion about research in AI and autonomy. First, Dr. Andrea Gilli is a researcher at the NATO Defense College in Rome, where he works on defense innovation, military transformation, and armed forces modernization. And second, Ms. Zoe Stanley-Lockman is a fellow at the Maritime Security Programme of the Institute of Defence and Strategic Studies at the Rajartnam School of International Studies in Singapore, where she is researching, among other things, the roles of ethics in AI.
and the U.S. Department of Defence's Office of Net Assessment, and worked and conducted research for or been associated with several institutions, including the Royal United Services Institute, the European
ai with ai: Darcraft Shadows
/our-media/podcasts/ai-with-ai/season-2/2-15
 In recent announcements, Andy and Dave discuss the National Endowment for Science, Technology, and the Arts (Nesta) launch of a project that is ‘Mapping AI Governance;’ MIT Tech Review’s survey of AI and ML research suggests that “the era of deep learning coming to an end” (or does it?); a December 2018 survey shows strong opposition to “killer robots;” China has (internally) released a report on its view of the “State of AI in China;” and DARPA wants to build conscious robots using insect brains, announcing its (mu)BRAIN Program. In research topics, Andy and Dave discuss the recent competition between DeepMInd’s AlphaStar and human professional gamers in playing Starcraft II. MIT and Microsoft have created a model that can identify instances where autonomous systems have learned from training examples that don’t match what’s happening in the real world, thus creating blind spots. Boston University publishes research that allows an ordinary camera to “see” around corners using shadow projection, in essence turning a wall into a mirror – and doing so without any AI or ML techniques. In papers and reports, the Office of the Director for National Intelligence releases its AIM Initiative – a strategy for augmenting intelligence using machines; a report provides a survey of the state of self-driving cars, and another report surveys the state of AI/ML in medicine. Game Changer takes a look at AlphaZero’s chess strategies, while The Hundred-Page Machine Learning Book offers a condensed overview of ML. The Association for the Advancement of AI conference (27 Jan – 1 Feb) begins to release videos of the conference, including an Oxford-style debate on the Future of AI. And finally, Andy and Dave conclude with a “hype teaser” for next week – with SELF AWARE robots!
Technical discussion (DeepMind blog) Video of match (2.5 hrs) Additional resources (released by DeepMind) Aleksi Pietikainen’s assessment of AlphaStar’s performance Timothy Lee’s critique
cna talks: The War on Terror, 18 Years Later
/our-media/podcasts/cna-talks/2019/9/the-war-on-terror-18-years-later
On the anniversary of the 9/11 attacks, Jon Schroden and David Knoll reflect on eighteen years of the War on Terror.
assistance, insurgency/counterinsurgency, unconventional warfare, stability operations and operations assessment. David Knoll   is an expert in military innovation, irregular warfare and non-state ... Materials CNA : Independent Assessment of U.S. Government Efforts against Al Qaeda ContactName /*/Contact/ContactName ContactTitle /*/Contact/JobTitle ContactEmail /*/Contact/Email
A Primer on Countering Mis-/Dis-/Mal-Information
/reports/2024/03/a-primer-on-countering-mis-/dis-/mal-information
A plain-language explanation of research on four interventions to counter Mis-/Dis-/Mal-Information: inoculation, debunking, factchecking, and media literacy.
hoping to understand the state of research on these issues, more specific guidance—in the form of an assessment of applicability to military populations, a list of best practices, and recommendations
cna talks: The Navy and Strategic Competition with China
/our-media/podcasts/cna-talks/2023/12/the-navy-and-strategic-competition-with-china
The Chief of Staff to the Secretary of the Navy asked CNA for recommendations on how the Navy can better position itself for such competition, that is, below the threshold of armed conflict. In this episode, three experts from across CNA join the show to discuss their specific recommendations and what the future fleet needs to look like to implement them. 
 is the vice president and director of CNA’s  Systems, Tactics and Force Development Division . He formerly served as director of the Strategic, Defensive, and Science/Technology Division at the Cost Assessment