# Why do we call it a “positive definite matrix” rather than a “positively definite matrix”?

The term positive definite matrix is a standard one used in mathematics, especially in linear algebra.

Are there grammatical, linguistic, or historical reasons why it was not called a positively definite matrix instead?

• In “positive definite matrix,” but “positive” and “definite” describe “matrix.” It is not positively definite, but positive and definite. – James McLeod Dec 24 '19 at 22:29
• This is a surprisingly difficult question to answer. At present the best I can do is to refer to DISTRIBUTION FUNCTIONS AND POSITIVE-DEFINITE FUNCTIONS BY S. BOCHNER AND B. JESSEN (Ann. Math.Vol. 39, No. 4, October, 1938). That shows that the term was in use in the 1930s. I speculate that it is a literal translation of a German compound noun (as that is the language in which Bochner usually wrote), but I cannot prove it. – JeremyC Dec 24 '19 at 23:09
• @JeremyC: I can find positiv definit in an 1890 paper of Felix Klein. (die quadratische Form positiv definit ist) But definit doesn't seem to be a native German word ... its mathematical meaning must be borrowed from another language. – Peter Shor Dec 25 '19 at 0:07
• @JamesMcLeod Two problems: 1. it is often hyphenated (positive-definite), even in some of the examples of usage given in the OED, including the very first one (1904 Trans. Amer. Math. Soc. 5 464 It is well known that there is always one such invariant, a positive-definite Hermitian form.) This is for a Hermitian form, but a matrix can, of course, be associated to a quadratic form. 2. A positive matrix is something else, namely, a matrix in which all the elements are strictly greater than zero. – linguisticturn Dec 25 '19 at 9:07
• This question is more properly asked and addressed on Maths SE. It needs specialist knowledge to know (a) whether the string positive definite is better considered unitary or binary, (b) if binary, then whether 'positive' modifies 'definite matrix' or 'matrix', and (c) why the term was chosen. – Edwin Ashworth Dec 25 '19 at 11:46

Yes, it seems that there are linguistic reasons1 why positive definite works better than positively definite.

1BTW, for that reason, I think that it was a mistake to migrate this question from the English Language and Usage (EL&U) StackExchange to the History of Science and Mathematics (HSM) StackExchange.

It is unlikely we can really answer why we have that preference any more than we can answer why we prefer e.g. all friends of Kim's to all Kim's friends; at the present state of our knowledge, probably the best we can reliably do is state trends and tendencies. Despite that, I will speculate about one possible reason, below.

Discussion

Consider this example (I'm of course not saying that the actual claims made in the example are correct):

There are two types of Indic languages, namely

(a) anciently Indic languages and contemporarily Indic languages.
(b) ancient-Indic languages and contemporary-Indic languages.

In (a), anciently Indic is a syntactic construction: it is an adjective phrase (AdjP) whose head is the adjective Indic and which has the adverb anciently as a modifier. The meaning is 'Indic in an ancient manner' (and analogously for contemporarily Indic).

According to CGEL (pp. 1657–1658), in (b), ancient-Indic is a morphological compound: ancient and Indic combine to produce a new word (and similarly for contemporary-Indic).

The point is that, to my ear at least, (b) is clearly preferable to (a).

I admit that I don't understand why CGEL is so sure that the construction in (b) is morphological and not syntactical (I will probably post a separate question about it). But if CGEL is correct about this, then perhaps this might be the reason why we prefer (b): we would like the type labels to be syntactically simple, to be actual terms, lexical items, as opposed to syntactic phrases.

There are numerous other examples that could be constructed:

We manufacture sandals in two types of blue, so we have light-blue sandals and dark-blue sandals.

(preferred to lightly blue sandals and darkly blue sandals)

Thus you end up with two types of cream: the steaming-hot cream and icy-cold cream.

(preferred to steamingly hot cream and icyly cold cream)

Positive definite

As far as positive definite, let's start with some definitions. First of all, when it comes to the notion of definiteness, the basic object is a quadratic form. The next step is to realize that to every matrix, one can associate a quadratic form. A matrix is then called definite if the associated quadratic form is definite; it's called positive definite if the associated quadratic form is positive definite, etc.

For a diagonalizable matrix, these properties of definiteness are easily relatable to the properties of the eigenvalues of the matrix, and some sources proceed to simply define positive definiteness of a matrix in terms of the properties of its eigenvalues. I personally dislike that practice, but that's definitely a matter of taste.

Definite Quadratic Forms. Since it is homogeneous, every quadratic form is zero at the origin. We call the quadratic form Q definite if it is nonzero everywhere else: Q(x)≠0 for x≠0.

If Q(x) is a definite quadratic form, then one of the following inequalities holds:

Q(x)>0 for all x≠0 (Q is positive definite), or
Q(x)<0 for all x≠0 (Q is negative definite).

Thus we have two types of definite quadratic forms: positive definite and negative definite.

The analogy with what I said above about ancient-Indic, dark-blue, etc. would be complete if positive definite were hyphenated. It is definitely sometimes hyphenated, including in two of the examples of usage in the OED (the ones from 1904 and 1957):

positive definite adj. Mathematics (of a function) having positive (formerly, positive or zero) values for all non-zero values of its argument; (of a square matrix) having all its eigenvalues positive; (more widely, of an operator on a Hilbert space) such that the inner product of any element of the space with its image under the operator is greater than zero.

1904   Trans. Amer. Math. Soc. 5 464   It is well known that there is always one such invariant, a positive-definite Hermitian form.
1948   W. V. Houston Princ. Math. Physics (ed. 2) vii. 120   The potential energy will be a quadratic expression in the coordinates that, if the equilibrium is stable, will be a positive definite expression.
1957   L. Fox Numerical Solution Two-point Boundary Probl. vii. 179   If all the λτ are positive, which is the case in many physical problems, and corresponds to some structure of the differential system corresponding to a positive-definite matrix A.., we can also assert [etc.].
1990   IMA Jrnl. Numerical Anal. 10 546   Hk is a positive definite matrix that approximates the inverse reduced Hessian matrix.

It is an interesting question why hyphenation came to be disfavored. But the fact that it came to be disfavored does not, I think, make this case substantially different from ancient-Indic, dark-blue, etc.

• I think this is quite right. On the face of it, a "positively definite" matrix would apparently mean "a matrix that is not just a little bit definite, but positively so", which isn't what "positive definite" is supposed to mean. – Robert Furber Dec 27 '19 at 12:39

As far as I know, the first appearance of the concept of positive/negative definiteness (and of indefiniteness) is in the article 271 of Gauss' Disquisitiones Arithmeticae about ternary forms. Of course the Disquisitiones are written in Latin, but maybe the original context can help in clarify the terminology also in English.

Gauss wrote

Quaedam formae ternariae ita sunt comparatae, ut per ipsas [...] possint repraesentari numeri positivi et negativi [...] formae indefinitae vocabuntur. [...] Contra per alias numeri negativi repraesentari nequeunt [...] quare formae positivae dicentur [...] formae positivae et negativae nomine communi formae definitae dicentur.

that is

Certain ternary forms are so constructed that positive and negative numbers can be represented by them [...] they will be called indefinite forms. [...] On the other hand by some other forms, negative numbers cannot be represented [...] and so they will be called positive forms [...] positive and negative forms will be called by the communal name of definite forms.

So it is clear that the terms "positive" and "negative" are not referred to "definite", and then it is absolutely correct to say "positive definite form". Maybe the real question is why we call them "positive definite forms" when "positive forms" would be (at least) equally correct.

Indeed note that Gauss never wrote "positive definite form" but simply "positive form" or "definite form" for a form that can be positive or negative.

Here an example in the same article:

formae definitae semper adiunctam esse definita et quidem (my emphasis) negativam [...]

that is

the adjoint of a definite form is always definite and more precisely negative

where it s clear that the first time "definite form" means "positive or negative", while the Latin term "quidem" is used to express emphasis and to further specify that the adjoint form is not simply a definite form but a negative one.