Jump to content

Donald Knuth

From Niidae Wiki

Template:Short description Template:Use mdy dates Template:Infobox scientist Donald Ervin Knuth (Template:IPAc-en<ref name="faq"/> Template:Respell; born January 10, 1938) is an American computer scientist and mathematician. He is a professor emeritus at Stanford University. He is the 1974 recipient of the ACM Turing Award, informally considered the Nobel Prize of computer science.<ref name = "Turing Award"/> Knuth has been called the "father of the analysis of algorithms".<ref>Template:Cite journal</ref>

Knuth is the author of the multi-volume work The Art of Computer Programming. He contributed to the development of the rigorous analysis of the computational complexity of algorithms and systematized formal mathematical techniques for it. In the process, he also popularized the asymptotic notation. In addition to fundamental contributions in several branches of theoretical computer science, Knuth is the creator of the TeX computer typesetting system, the related METAFONT font definition language and rendering system, and the Computer Modern family of typefaces.

As a writer and scholar, Knuth created the WEB and CWEB computer programming systems designed to encourage and facilitate literate programming, and designed the MIX/MMIX instruction set architectures. He strongly opposes the granting of software patents, and has expressed his opinion to the United States Patent and Trademark Office and European Patent Organisation.

Biography

[edit]

Early life

[edit]

Donald Knuth was born in Milwaukee, Wisconsin, to Ervin Henry Knuth and Louise Marie Bohning.<ref name="MacTutor">Template:MacTutor</ref> He describes his heritage as "Midwestern Lutheran German".Template:R His father owned a small printing business and taught bookkeeping.<ref name="Raskin2013">Template:Cite book</ref> While a student at Milwaukee Lutheran High School, Knuth thought of ingenious ways to solve problems. For example, in eighth grade, he entered a contest to find the number of words that the letters in "Ziegler's Giant Bar" could be rearranged to create; the judges had identified 2,500 such words. With time gained away from school due to a fake stomachache, Knuth used an unabridged dictionary and determined whether each dictionary entry could be formed using the letters in the phrase. He identified over 4,500 words, winning the contest.<ref name="Feigenbaum 2007">Template:Cite web</ref>Template:Rp As prizes, the school received a new television and enough candy bars for all of his schoolmates to eat.<ref>Template:Cite book</ref><ref>Template:Cite book</ref>

Education

[edit]

Knuth received a scholarship in physics to the Case Institute of Technology (now part of Case Western Reserve University) in Cleveland, Ohio, enrolling in 1956.<ref name="ency2020">Template:Cite web</ref> He also joined the Beta Nu Chapter of the Theta Chi fraternity. While studying physics at Case, Knuth was introduced to the IBM 650, an early commercial computer. After reading the computer's manual, Knuth decided to rewrite the assembly and compiler code for the machine used in his school because he believed he could do it better.<ref name="Koshy2004">Template:Cite book</ref>

In 1958, Knuth created a program to help his school's basketball team win its games.<ref>Template:Cite web</ref> He assigned "values" to players in order to gauge their probability of scoring points, a novel approach that Newsweek and CBS Evening News later reported on.<ref name= "Koshy2004"/>

Knuth was one of the founding editors of the Case Institute's Engineering and Science Review, which won a national award as best technical magazine in 1959.<ref name="BetaNu-Case-edu">Template:Cite web</ref><ref name="BetaNu-ThetaChi-org">Template:Cite web</ref> He then switched from physics to mathematics, and received two degrees from Case in 1960:<ref name="ency2020" /> his Bachelor of Science, and simultaneously a master of science by a special award of the faculty, who considered his work exceptionally outstanding.<ref name = "Turing Award">Template:Cite web</ref><ref name = "Koshy2004" />

At the end of his senior year at Case in 1960, Knuth proposed to Burroughs Corporation to write an ALGOL compiler for the B205 for $5,500. The proposal was accepted and he worked on the ALGOL compiler between graduating from Case and going to Caltech. Template:R<ref name="Waychoff 1979">Template:Cite web</ref>Template:Rp

In 1963, with mathematician Marshall Hall as his adviser,<ref name=mathgene/> he earned a PhD in mathematics from the California Institute of Technology, with a thesis titled Finite Semifields and Projective Planes.<ref>Template:Cite thesis</ref>

Early work

[edit]

In 1963, after receiving his PhD, Knuth joined Caltech's faculty as an assistant professor.<ref name=vitae/>

While at Caltech and after the success of the Burroughs B205 ALGOL compiler, he became consultant to Burroughs Corporation, joining the Product Planning Department. At Caltech he was operating as a mathematician but at Burroughs as a programmer working with the people he considered to have written the best software at the time in the ALGOL compiler for the B220 computer (successor to the B205).Template:R

Knuth was offered a $100,000 contract to write compilers at Green Tree Corporation but turned it down making a decision not to optimize income and continued at Caltech and Burroughs. He received a National Science Foundation Fellowship and Woodrow Wilson Foundation Fellowship but they had the condition that you could not do anything else but study as a graduate student so he would not be able to continue as a consultant to Burroughs. He chose to turn down the fellowships and continued with Burroughs.Template:R In summer 1962, he wrote a FORTRAN compiler for Univac, but considered that “I sold my soul to the devil” to write a FORTRAN compiler.Template:R

After graduating, Knuth returned to Burroughs in June 1961 but did not tell them he had graduated with a master's degree, rather than the expected bachelor's degree. Impressed by the ALGOL syntax chart, symbol table, recursive-descent approach and the separation of the scanning, parsing and emitting functions of the compiler Knuth suggested an extension to the symbol table that one symbol could stand for a string of symbols. This became the basis of the DEFINE in Burroughs ALGOL, which has since been adopted by other languages. However, some really disliked the idea and wanted DEFINE removed. The last person to think it was a terrible idea was Edsger Dijkstra on a visit to Burroughs.Template:R

Knuth worked on simulation languages at Burroughs producing SOL ‘Simulation Oriented Language’, an improvement on the state-of-the-art, co-designed with J. McNeeley. He attended a conference in Norway in May, 1967 organised by the people who invented the Simula language. Knuth influenced Burroughs to use Simula.<ref name="Dahl 2001">Template:Cite web</ref><ref name="Biography">Template:Cite web</ref> Knuth had a long association with Burroughs as a consultant from 1960 to 1968 until his move into more academic work at Stanford in 1969.<ref name="Nance">Template:Cite web</ref><ref name="Knuth CV">Template:Cite web</ref>

In 1962, Knuth accepted a commission from Addison-Wesley to write a book on computer programming language compilers. While working on this project, he decided that he could not adequately treat the topic without first developing a fundamental theory of computer programming, which became The Art of Computer Programming. He originally planned to publish this as a single book, but as he developed his outline for the book, he concluded that he required six volumes, and then seven, to thoroughly cover the subject. He published the first volume in 1968.<ref name=TAOCP>Template:Cite web</ref>

Just before publishing the first volume of The Art of Computer Programming, Knuth left Caltech to accept employment with the Institute for Defense Analyses' Communications Research Division,<ref name="Institute for Defense Analyses">Template:Cite web</ref> then situated on the Princeton campus, which was performing mathematical research in cryptography to support the National Security Agency.

In 1967, Knuth attended a Society for Industrial and Applied Mathematics conference and someone asked what he did. At the time, computer science was partitioned into numerical analysis, artificial intelligence, and programming languages. Based on his study and The Art of Computer Programming book, Knuth decided the next time someone asked he would say, "Analysis of algorithms".<ref name="quanta_magazine">Template:Cite web</ref>

In 1969, Knuth left his position at Princeton to join the Stanford University faculty,<ref name="Computer Science department timeline">Template:Cite web</ref> where he became Fletcher Jones Professor of Computer Science in 1977. He became Professor of The Art of Computer Programming in 1990, and has been emeritus since 1993.<ref name="homepage">Template:Cite web</ref><ref>Template:Cite web</ref>

Writings

[edit]

Knuth is a writer as well as a computer scientist.<ref name=vitae>Template:Cite web</ref>

The Art of Computer Programming (TAOCP)

[edit]

Template:Main Template:Blockquote

In the 1970s, Knuth called computer science "a totally new field with no real identity. And the standard of available publications was not that high. A lot of the papers coming out were quite simply wrong. ... So one of my motivations was to put straight a story that had been very badly told."<ref>Template:Cite web</ref>

From 1972 to 1973, Knuth spent a year at the University of Oslo among people such as Ole-Johan Dahl. This is where he had originally intended to write the seventh volume in his book series, which was to deal with programming languages. But Knuth had finished only the first two volumes when he came to Oslo, and thus spent the year on the third volume, next to teaching. The third volume came out just after Knuth returned to Stanford in 1973.<ref>Template:Cite web</ref>

Concrete Mathematics: A Foundation for Computer Science originated with an expansion of the mathematical preliminaries section of Volume 1 of TAoCP. Knuth found that there were mathematical tools necessary for Volume 1, but missing from his repertoire, and decided that a course introducing those tools to computer science students would be useful. Knuth introduced the course at Stanford in 1970. Course notes developed by Oren Patashnik evolved into the 1988 text, with authors Ronald Graham, Knuth, and Patashnik. A second edition of Concrete Mathematics was published in 1994.

By 2011, Volume 4A of TAoCP had been published.<ref name="TAOCP" /> In April 2020, Knuth said he anticipated that Volume 4 of TAoCP will have at least parts A through F.<ref name="quanta_magazine" /> Volume 4B was published in October 2022.

Other works

[edit]

Knuth is also the author of Surreal Numbers,<ref name=surreal/> a mathematical novelette on John Horton Conway's set theory construction of an alternate system of numbers. Instead of simply explaining the subject, the book seeks to show the development of the mathematics. Knuth wanted the book to prepare students for doing original, creative research.

In 1995, Knuth wrote the foreword to the book A=B by Marko Petkovšek, Herbert Wilf and Doron Zeilberger.<ref>Template:Cite web</ref> He also occasionally contributes language puzzles to Word Ways: The Journal of Recreational Linguistics.<ref>Template:Cite web</ref>

Knuth has delved into recreational mathematics. He contributed articles to the Journal of Recreational Mathematics beginning in the 1960s, and was acknowledged as a major contributor in Joseph Madachy's Mathematics on Vacation.<ref>Madachy, Joseph S.,Mathematics on Vacation, Thomas Nelson & Sons Ltd. 1966</ref>

Knuth also appears in a number of Numberphile<ref>Template:Cite web</ref> and Computerphile videos on YouTube, where he discusses topics from writing Surreal Numbers<ref>Template:CitationTemplate:Cbignore</ref> to why he does not use email.<ref>Template:Citation</ref>

Knuth had proposed the name "algorithmics" as a better name for the discipline of computer science.<ref>Template:Cite book</ref>

Works about his religious beliefs

[edit]

In addition to his writings on computer science, Knuth, a Lutheran,Template:Sfn is also the author of 3:16 Bible Texts Illuminated,<ref>Template:Cite book</ref> in which he examines the Bible by a process of systematic sampling, namely an analysis of chapter 3, verse 16 of each book. Each verse is accompanied by a rendering in calligraphic art, contributed by a group of calligraphers led by Hermann Zapf. Knuth was invited to give a set of lectures at MIT on the views on religion and computer science behind his 3:16 project, resulting in another book, Things a Computer Scientist Rarely Talks About, where he published the lectures God and Computer Science.<ref name="Knuth 2001 Rarely Talks">Template:Cite book</ref>

Opinion on software patents

[edit]

Knuth strongly opposes granting software patents to trivial solutions that should be obvious, but has expressed more nuanced views for nontrivial solutions such as the interior-point method of linear programming.<ref>Template:Cite journal</ref> He has expressed his disagreement directly to both the United States Patent and Trademark Office and European Patent Organisation.<ref>Template:Cite web to the patent offices in the USA and Europe.</ref>

Programming

[edit]

Digital typesetting

[edit]

In the 1970s, the publishers of TAOCP abandoned Monotype in favor of phototypesetting. Knuth became so frustrated with the inability of the latter system to approach the quality of the previous volumes, which were typeset using the older system, that he took time out to work on digital typesetting and created TeX and Metafont.<ref>Template:Cite web</ref>

Literate programming

[edit]

While developing TeX, Knuth created a new methodology of programming, which he called literate programming, because he believed that programmers should think of programs as works of literature:

Template:Blockquote

Knuth embodied the idea of literate programming in the WEB system. The same WEB source is used to weave a TeX file, and to tangle a Pascal source file. These in their turn produce a readable description of the program and an executable binary respectively. A later iteration of the system, CWEB, replaces Pascal with C, C++, and Java.<ref>Template:Cite web</ref>

Knuth used WEB to program TeX and METAFONT, and published both programs as books, both originally published the same year: TeX: The Program (1986); and METAFONT: The Program (1986).<ref>Template:Cite web</ref> Around the same time, LaTeX, the now-widely adopted macro package based on TeX, was first developed by Leslie Lamport, who later published its first user manual in 1986.<ref>Template:Cite book</ref>

Personal life

[edit]

Donald Knuth married Nancy Jill Carter on 24 June 1961, while he was a graduate student at the California Institute of Technology. They have two children: John Martin Knuth and Jennifer Sierra Knuth.<ref name="OConnerEtRobertson">Template:Cite web</ref>

Knuth gives informal lectures a few times a year at Stanford University, which he calls "Computer Musings". He was a visiting professor at the Oxford University Department of Computer Science in the United Kingdom until 2017 and an Honorary Fellow of Magdalen College.<ref>Template:Cite web</ref><ref>Template:Cite web</ref>

Knuth is an organist and a composer. He and his father served as organists for Lutheran congregations. Knuth and his wife have a 16-rank organ in their home.<ref>Template:Cite web</ref> In 2016 he completed a piece for organ, Fantasia Apocalyptica, which he calls a "translation of the Greek text of the Revelation of Saint John the Divine into music". It was premièred in Sweden on January 10, 2018.<ref>Template:Cite news</ref>

Chinese name

[edit]

Knuth's Chinese name is Gao Dena (Template:Lang-zh).<ref>Template:Cite journal</ref><ref name="faq"/> He was given this name in 1977 by Frances Yao shortly before making a three-week trip to China.<ref name="faq">Template:Cite web</ref><ref name="The Art of Computer Programming"/> In the 1980 Chinese translation of Volume 1 of The Art of Computer Programming (Template:Lang-zh), Knuth explains that he embraced his Chinese name because he wanted to be known by the growing numbers of computer programmers in China at the time. In 1989, his Chinese name was placed atop the Journal of Computer Science and TechnologyTemplate:'s header, which Knuth says "makes me feel close to all Chinese people although I cannot speak your language".<ref name="The Art of Computer Programming">Template:Cite book</ref>

Humor

[edit]
File:Knuth-check2.png
One of Knuth's reward checks

Knuth used to pay a finder's fee of $2.56 for any typographical errors or mistakes discovered in his books, because "256 pennies is one hexadecimal dollar", and $0.32 for "valuable suggestions". According to an article in the Massachusetts Institute of Technology's Technology Review, these Knuth reward checks are "among computerdom's most prized trophies". Knuth had to stop sending real checks in 2008 due to bank fraud, and now gives each error finder a "certificate of deposit" from a publicly listed balance in his fictitious "Bank of San Serriffe".<ref>Template:Cite journal</ref>

He once warned a correspondent, "Beware of bugs in the above code; I have only proved it correct, not tried it."<ref name="faq"/>

Knuth published his first "scientific" article in a school magazine in 1957 under the title "The Potrzebie System of Weights and Measures". In it, he defined the fundamental unit of length as the thickness of Mad No. 26, and named the fundamental unit of force "whatmeworry". Mad published the article in issue No. 33 (June 1957).<ref>Template:Cite magazine</ref><ref name="kidder">Template:Cite book</ref>

To demonstrate the concept of recursion, Knuth intentionally referred "Circular definition" and "Definition, circular" to each other in the index of The Art of Computer Programming, Volume 1.

The preface of Concrete Mathematics has the following paragraph:Template:Blockquote

At the TUG 2010 Conference, Knuth announced a satirical XML-based successor to TeX, titled "iTeX" (Template:IPA, spoken while ringing a bell), which would support features such as arbitrarily scaled irrational units, 3D printing, input from seismographs and heart monitors, animation, and stereophonic sound.<ref>Template:Cite web</ref><ref>Template:Citation</ref><ref>Template:Cite journal</ref>

Awards and honors

[edit]

In 1971, Knuth received the first ACM Grace Murray Hopper Award.<ref name="Turing Award" /> He has received various other awards, including the Turing Award, the National Medal of Science, the John von Neumann Medal, and the Kyoto Prize.<ref name="Turing Award" />

Knuth was elected a Distinguished Fellow of the British Computer Society (DFBCS) in 1980 in recognition of his contributions to the field of computer science.<ref name=BCS>Template:Cite web</ref>

In 1990, he was awarded the one-of-a-kind academic title Professor of The Art of Computer Programming; the title has since been revised to Professor Emeritus of The Art of Computer Programming.

Knuth was elected to the National Academy of Sciences in 1975. He was also elected a member of the National Academy of Engineering in 1981 for organizing vast subject areas of computer science so that they are accessible to all segments of the computing community. In 1992, he became an associate of the French Academy of Sciences. Also that year, he retired from regular research and teaching at Stanford University in order to finish The Art of Computer Programming. He was elected a Foreign Member of the Royal Society in 2003.<ref name=formemrs/>

Knuth was elected as a Fellow (first class of Fellows) of the Society for Industrial and Applied Mathematics in 2009 for his outstanding contributions to mathematics.<ref>Template:Cite web</ref> He is a member of the Norwegian Academy of Science and Letters.<ref>Template:Cite web</ref> In 2012, he became a fellow of the American Mathematical Society<ref>Template:Cite web</ref> and a member of the American Philosophical Society.<ref>Template:Cite web</ref> Other awards and honors include: Template:Div col

Template:Div col end

Publications

[edit]

A short list of his publications include:<ref name = "books">Template:Cite web</ref>

The Art of Computer Programming: Template:Refbegin

  1. Template:Cite book
  2. Template:Cite book
  3. Template:Cite book
  4. Template:Cite book
  5. Template:Cite book
  6. Template:Cite book
  7. Template:Cite book
  8. Template:Cite book
  9. Template:Cite book
  10. Template:Cite book
  11. Template:Cite book
  12. Template:Cite book
  13. Template:Cite book
  14. Template:Cite bookTemplate:Refend

Computers and Typesetting (all books are hardcover unless otherwise noted): Template:Refbegin

  1. Template:Cite book, x+483pp.
  2. Template:Cite book (softcover).
  3. Template:Cite book, xviii+600pp.
  4. Template:Cite book, xii+361pp.
  5. Template:Cite book (softcover).
  6. Template:Cite book, xviii+566pp.
  7. Template:Cite book, xvi+588pp.
  8. Template:Cite book

Template:Refend

Books of collected papers: Template:Refbegin

  1. Template:Cite book<ref>Template:Cite web</ref>
  2. Template:Cite book<ref>Template:Cite web</ref>
  3. Template:Cite book<ref>Template:Cite journal</ref>
  4. Template:Cite book<ref>Template:Cite web</ref>
  5. Template:Cite book, Template:Isbn (paperback)<ref>Template:Cite web</ref>
  6. Template:Cite book, Template:Isbn (paperback)<ref>Template:Cite web</ref>
  7. Donald E. Knuth, Selected Papers on Design of Algorithms (Stanford, California: Center for the Study of Language and Information—CSLI Lecture Notes, no. 191), 2010. Template:Isbn (cloth), Template:Isbn (paperback)<ref>Template:Cite web</ref>
  8. Donald E. Knuth, Selected Papers on Fun and Games (Stanford, California: Center for the Study of Language and Information—CSLI Lecture Notes, no. 192), 2011. Template:Isbn (cloth), Template:Isbn (paperback)<ref>Template:Cite web</ref>
  9. Donald E. Knuth, Companion to the Papers of Donald Knuth (Stanford, California: Center for the Study of Language and Information—CSLI Lecture Notes, no. 202), 2011. Template:Isbn (cloth), Template:Isbn (paperback)<ref>Template:Cite web</ref>

Template:Refend

Other books: Template:Refbegin

  1. Template:Cite book xiv+657 pp.
  2. Template:Cite book<ref name=surreal>Template:Cite web</ref>
  3. Donald E. Knuth, The Stanford GraphBase: A Platform for Combinatorial Computing (New York, ACM Press) 1993. second paperback printing 2009. Template:Isbn
  4. Donald E. Knuth, 3:16 Bible Texts Illuminated (Madison, Wisconsin: A-R Editions), 1990. Template:Isbn
  5. Donald E. Knuth, Things a Computer Scientist Rarely Talks About (Center for the Study of Language and Information—CSLI Lecture Notes no 136), 2001. Template:Isbn
  6. Donald E. Knuth, MMIXware: A RISC Computer for the Third Millennium (Heidelberg: Springer-Verlag— Lecture Notes in Computer Science, no. 1750), 1999. viii+550pp. Template:Isbn
  7. Donald E. Knuth and Silvio Levy, The CWEB System of Structured Documentation (Reading, Massachusetts: Addison-Wesley), 1993. iv+227pp. Template:Isbn. Third printing 2001 with hypertext support, ii + 237 pp.
  8. Donald E. Knuth, Tracy L. Larrabee, and Paul M. Roberts, Mathematical Writing (Washington, D.C.: Mathematical Association of America), 1989. ii+115pp Template:Isbn
  9. Daniel H. Greene and Donald E. Knuth, Mathematics for the Analysis of Algorithms (Boston: Birkhäuser), 1990. viii+132pp. Template:Isbn
  10. Donald E. Knuth, Template:Lang, 1976. 106pp. Template:Isbn
  11. Donald E. Knuth, Stable Marriage and Its Relation to Other Combinatorial Problems: An Introduction to the Mathematical Analysis of Algorithms. Template:Isbn
  12. Donald E. Knuth, Axioms and Hulls (Heidelberg: Springer-Verlag—Lecture Notes in Computer Science, no. 606), 1992. ix+109pp. Template:Isbn

Template:Refend

See also

[edit]

Template:Div col

Template:Div col end

References

[edit]

Template:Reflist

Bibliography

[edit]

Template:Refbegin

Template:Refend

[edit]

Template:Sister project links

Template:Navboxes Template:Authority control

Retrieved from "https://wiki.niidae.com/index.php?title=Donald_Knuth&oldid=10924"