Editing Neural network (machine learning) (section)

===Training ===
A common criticism of neural networks, particularly in robotics, is that they require too many training samples for real-world operation.<ref>{{cite journal |last1=Parisi |first1=German I. |last2=Kemker |first2=Ronald |last3=Part |first3=Jose L. |last4=Kanan |first4=Christopher |last5=Wermter |first5=Stefan |date=1 May 2019 |title=Continual lifelong learning with neural networks: A review |journal=Neural Networks |volume=113 |pages=54–71 |doi=10.1016/j.neunet.2019.01.012 |pmid=30780045 |issn=0893-6080|doi-access=free |arxiv=1802.07569 }}</ref>
Any learning machine needs sufficient representative examples in order to capture the underlying structure that allows it to generalize to new cases. Potential solutions include randomly shuffling training examples, by using a numerical optimization algorithm that does not take too large steps when changing the network connections following an example, grouping examples in so-called mini-batches and/or introducing a recursive least squares algorithm for [[cerebellar model articulation controller|CMAC]].<ref name="Qin1"/>
Dean Pomerleau uses a neural network to train a robotic vehicle to drive on multiple types of roads (single lane, multi-lane, dirt, etc.), and a large amount of his research is devoted to extrapolating multiple training scenarios from a single training experience, and preserving past training diversity so that the system does not become overtrained (if, for example, it is presented with a series of right turns—it should not learn to always turn right).<ref>Dean Pomerleau, "Knowledge-based Training of Artificial Neural Networks for Autonomous Robot Driving"</ref>