I do not believe Cauchy wrote anything explicit concerning the extent to which we can deduce differentiability from continuity. However, in many places it seems that Cauchy assumes continuity and then introduces derivatives. From what I can determine, this has led historians to "read Cauchy" in different ways according to the embedded contextual world-view the historian felt was appropriate. In what follows I have assembled a number of relevant publications and excerpts that give a sense of what people have written about this and related issues for the period of time between Ampère (1806) and Weierstrass (1872).
[1] Umberto Bottazzini, The Higher Calculus: A History of Real and Complex Analysis from Euler to Weierstrass, translated by Warren Van Egmond, Springer-Verlag, 1986, vi + 332 pages.
Section 3.6. Cauchy's Definitions of Derivative and Differential (pp. 117-122) contains a discussion of the issue at hand.
(from pp. 118-119) In the same volume of the Journal de l'Ecole polytechnique that contained Lagrange's supplement, A. M. Ampere (1775-1836) published a long note whose object was "a new demonstration of the Taylor series." In criticizing Lagrange's assumption, Ampère sought to demonstrate that it is possible for every function $f(x)$ to be expanded in a series of increasing powers$.^{23}$ [Bottazzini cites Grabiner's 1978 paper and 1981 book.] He began from a definition of the derivative that was based on a property of derived functions found by Lagrange. This property was stated by Ampère as, [begin indented text] Let $A$ and $K$ be the values of $f(x)$ corresponding to $x=a$ and $x=k.$ One can always suppose that $a$ and $k$ are chosen in such a way that $f(x)$ never becomes infinite in the interval and that neither $A=k$ nor $a=k,$ so that $\frac{K-A}{k-a}$ is neither zero nor infinite, and that one can take this quantity for that above or below which one can always take $[f(x+i)-f(x)]/i,$ giving to $i$ a value as small as necessary (1806a, p. 151). [end indented text] From this property Ampère drew the definition of derivative that to him "seemed the most general and the most rigorous possible" (ibid., p. 156). "The derived function of $f(x)$ is a function of $x$ such that $[f(x+i)-f(x)]/i$ is always included between two of the values that this derived function takes between $x$ and $x+i,$ whatever $x$ and $i$ may be (ibid.). Ampère's work and his lectures at the École Polytechnique did not go without influence on Cauchy, who cites Ampère among those to whom he is indebted in both the Cours d'analyse and in the Résumé. But Cauchy's approach reverses the terms of the problem: by defining the derivative of a function (if it exists) as a suitable limit, what Ampère had given as a definition became a property of the derivative, expressible as a theorem.
[2] Carl Benjamin Boyer, The Concepts of the Calculus. A Critical and Historical Discussion of the Derivative and the Integral, Columbia University Press, 1939, vii + 346 pages. [Reprinted by Dover Publications in 1959, with the title changed to The History of the Calculus and Its Conceptual Development.]
(from middle of p. 282) The geometrical intuitions which intruded themselves into Cauchy's view of irrational number likewise led him erroneously to believe that the continuity of a function was sufficient for its geometrical representation and for the existence of a derivative$.^{45}$ [Jourdain's 1905 paper is cited.] A. M. Ampère also had been led by geometric preconceptions similar to those of Cauchy to try to demonstrate the false proposition that every continuous function has a derivative, except for certain isolated values in the interval$.^{46}$ [Pringsheim/Molk is cited.]
[3] Louis Philippe Gilbert, Mémoire sur l'existence de la dérivée dans les fonctions continues [Memoir on the existence of the derivative in continuous functions], Mémoires Couronnés et Autres Mémoires, publiés par l'Académie Royale des Sciences, des Lettres et des Beaux-Arts de Belgique 23 #3 (1873), vi + 31 pages.
See also Eugène Charles Catalan's 1872 advance report on Gilbert's memoir (9 pages, in French) and Gilbert's 1872 Sur une objection proposée par M. Catalan [On an objection proposed by Mr. Catalan] (5 pages, with a 1-paragraph response by Catalan on p. 502) and Gilbert's 1872 Rectification au sujet d'un mémoire précédent [Correction to the subject of the preceding memoir] (9 pages).
Note: Gilbert originally argued (in his earlier written memoir, which has the "official publication" year of 1873) that there were errors in Hankel's 1870 work and that Hankel did not actually show there exist continuous functions that are non-differentiable on dense sets (or "everywhere" non-differentiable; I am not sure to what extent Gilbert originally made a distinction between non-differentiable on every interval and being non-differentiable at every point). Gilbert's approach was based on Lamarle's methods and was intended to conclusively prove that a continuous function is differentiable except for an isolated set of points (see Gilbert's final theorem at the bottom of p. 31). However, after Gilbert learned of the results in Hermann Amandus Schwarz's 1873 paper Neues beispiel einer stetigen nicht differentiirbaren function [New example of a continuous non-differentiable function] French version, which gives a particularly simple example of a strictly increasing continuous function that is not differentiable at each nonzero dyadic rational number (in fact, at each such number the right derivative is $+\infty$ and the left derivative is positive and finite), Gilbert came to realize that Hankel's examples were possible. (Schwarz presented his example on 19 August 1873, but since Gilbert's Rectification was presented in a session dated 7 June 1873, Gilbert obviously knew about it before Schwarz's presentation. Incidentally, although Weierstrass' presentation of an everywhere non-differentiable continuous function was on 18 July 1872, I can find no mention of Weierstrass in Gilbert's Rectification.) In fact, some of Hankel's reasoning was not correct. However, I do not know to what extent Gilbert's criticism of Hankel were based on actual errors that Hankel made and to what extent Gilbert's criticism of Hankel were a result of errors in Gilbert's own reasoning. I believe Gilbert, in his Rectification, still felt that it was not possible for a continuous function to be non-differentiable at each point. With this in mind, it is perhaps worth noting that Gilbert repented his early 1870s views by giving a lengthy survey of this topic -- beginning with Ampère and including a detailed discussion of Hankel's and Schwarz's examples, and even the Weierstrass nowhere differentiable continuous function -- in Note II (pp. 467-475) in the 1878 2nd edition of his textbook Cours d'Analyse Infinitésimale. Partie Élémentaire.
[4] Judith Victor Grabiner, The origins of Cauchy's theory of the derivative, Historia Mathematica 5 #4 (November 1978), 379-409.
(first full paragraph on p. 381) Cauchy first presented his definition of the derivative to the mathematical world in his Leçons sur le calcul infinitésimal of 1823. He defined the derivative $f'(x)$ of a continuous function $f(x)$ as the limit, when it exists, of the ratio $f(x+i)-f(x)/i$ as $i$ went to zero. But it is not the mere definition of the derivative as the limit of the quotient of differences which constitutes Cauchy's achievement. Newton, after all, had described some of his results in terms of limits [Newton 1934, Scholium to Lemma XI]. Jean-le-Rond D'Alembert, under Newton's influence, had explicitly defined the differential quotient as the limit of the quotient of differences [1789, article "Différentiel." The definition used by D'Alembert was fairly common by the end of the eighteenth century. See Boyer 1949, Chapter VI.] The difference between Cauchy's work and that of men like D'Alembert lies in the understanding and the use of the definition. D'Alembert did not have what we now call a delta-epsilon translation of the limit-concept; as we shall see, Cauchy did. The only real use D'Alembert made of his definition was to illustrate the finding of a tangent to a parabola as the limit of secants [op. cit.]. In contrast, Cauchy's definition was the beginning of his task, not the end; his achievement was to produce an extended body of proved results about derivatives.
(middle of p. 383) [This appears after a translated quote from pp. 22-23 of Cauchy's 1823 book] Cauchy's phrase "this limit, when it exists" exemplifies his attitude toward rigor. Perhaps his use of the phrase was motivated only by the behavior of known functions at isolated points, but the language was sufficiently general to open the whole question of the existence or non-existence of derivatives. And, though his definition of derivative, like that of limit, is verbal, we shall see immediately that he translated the definition into the algebra of inequalities for use in proofs.
(from p. 396, lines 6-13) [Ampère's 1806 paper is discussed on pp. 395-400] Cauchy knew Ampère personally, and had once been his student. Cauchy said in the "Introduction" to his Cours d'analyse that he had "profited several times from the observations of M. Ampère, as well as from the methods that he [= Ampère] has developed in his lectures on analysis" [1821, vii-viii]. He more than once acknowledged Ampère's assistance in a general way [1821, vii; 1826, 10]. And Cauchy explicitly referred to Ampère's 1806 paper on the occasion of his own proof of (1) [1823, 44n; 1829, 268]. [Note: (1) is the statement $\min \{f'(x): \; a \leq x \leq b \} \; \leq \; \frac{f(b) - f(a)}{b - a} \; \leq \; \max \{f'(x): \; a \leq x \leq b \}.$]
(from lower middle of p. 396) Thus it is natural for us, in our search for Cauchy's sources, to examine Ampère's paper. The paper is, unfortunately, confusing to read and not very well organized. It has on occasion been misinterpreted as an attempt to prove that every continuous function is differentiable. The major source of this interpretation seems to be [Pringsheim 1909, 44]. [Note: I disagree. There are many references in the 19th century literature to Ampère's paper being an attempt to prove that continuous functions are differentiable, except at certain isolated points.] Ampère himself is partly responsible for this error; in his paper he used the term "exist" to describe a derivative when he meant that it was finite and non-zero [1806, 149]. Given the prevailing view on the part of many historians about the lack of rigor and sophistication in analysis before Cauchy, together with Ampère's unusual use of the term "exist," the misinterpretation of Ampère's words is not surprising. Nevertheless, this error has led to an unfortunate neglect of Ampère's paper by historians of the calculus. Since Ampère's innovations helped Cauchy learn to prove theorems about derivatives, they deserve to be looked at again with care.
Note: I believe I have encountered the use of "number exists" to mean "not zero" (and not negative) several times in very old papers and books (first half of 1800s), but I was not able to locate any specific such uses of "exists" at this time. My feeling is that the use of "exists" in this way is very similar to the use of "exists" for a set to mean that the set is not the empty set (this usage was very common from roughly the 1880s to the 1920s).
[5] Ivor Grattan-Guinness, The emergence of mathematical analysis and its foundational progress, 1780-1880, pp. 94-148 in Ivor Grattan-Guinness (editor), From the Calculus to Set Theory, 1630--1910. An Introductory History, Gerald Duckworth and Company, 1980, vi + 306 pages. [Reprinted by Princeton University Press in 2000.]
Some relevant comments about Cauchy and Ampère on the derivative appear on pp. 112-114, but everything of relevance to the issue at hand is contained in the excerpts I have given elsewhere. Nonetheless, the following comment may be of interest:
(from bottom of p. 112) An immediate problem is the question of whether or not a continuous function is differentiable. To us the answer is undoubtedly in the negative, for a function with a corner is continuous but not differentiable there. But in the unrigorous systems of the 18th and early 19th centuries the properties of continuity and differentiability were not so clearly defined anyway, and infinitesimals might allow a corner to be interpreted as an infinitely tight (but differentiable) loop.
[6] Ivor Grattan-Guinness, Convolutions in French Mathematics, 1800-1840, 3 volumes, Science Networks / Historical Studies #2, Birkhäuser Verlag, 1990, 1602 pages.
(from Volume 2, p. 749, 2nd paragraph) Cauchy's treatment of the calculus began in lecture 3. [This pertains to Cauchy's 1823 book Résumé ...] The difference quotient of a continuous function $y = f(x),\;$ (1152.1) $\;\Delta y / \Delta x \; = \; (f(x + \Delta x) - f(x))/\Delta x,$ 'may converge towards another limit, either positive, or negative' when $\Delta x \rightarrow 0.$ [Note: Of course, Cauchy did not use the arrow notation for limits, since this only slowly came into use from about 1908 to the 1920s. Grattan-Guinness explicitly points out on p. 717 that although Cauchy did not use the arrow notation, Grattan-Guinness will use it in his discussion of Cauchy.] 'This limit, when it exists, has a determinate value' (including $0,$ surely) a 'new function' of $x.$ He used Lagrange's notation '$f'(x)$' and name 'derived function' for this new function, but of course it was essentially the derivative that we recognise, not Lagrange's coefficient (322.8) in the Taylor expansion. The phrase 'when it exists' shows that Cauchy was aware that a continuous function need not have a derivative, although the examples which he then gave were all differentiable $(\sin x,\;A^{x},$ and so on); he did not give examples with corners (such as Fourier had shown with his series in Figure 926.1) or define left- and right-hand derivatives.
[7] Thomas William Hawkins, Lebesgue's Theory of Integration. Its Origins and Development, 2nd edition, Chelsea Publishing Company, 1975, xvi + 227 pages. [For the part I'm quoting, the 1970 1st edition, 1979 corrected 2nd edition, and the 2001 AMS reprint of the 1979 corrected 2nd edition are the same.]
(from pp. 43-44) A. M. Ampère [1806] sought to establish this corollary independently of (4) [(4) is the statement that $f(x+i)=f(x)+pi+qi^2+\cdots,$ where $p,$ $q,$ etc. are functions of $x$ only] and then use it to establish (4) without recourse to Lagrange's argument. It is his proof that became the paradigm for subsequent ones. What Ampère actually showed is that if $f'(x)$ exists for all $x$ $(f'(x)$ can be infinite for some values of $x)$ and if the difference quotient converges uniformly to $f'(x),$ then any interval $(a,k)$ must contain a point $x_0$ at which $f'(x_0)$ is finite and nonzero. This would imply that $f'(x)$ exists as a finite, nonzero quantity on a dense set. But Ampère interpreted his result to mean that $f'(x)$ is neither zero nor infinite except for "certain particular and isolated values of $x$" [1806: 149]. Between the appearance of Ampère's paper and 1870, the proposition that any (continuous) function is differentiable in general was stated and proved in most of the leading texts on the calculus$.^{11}$ [10 references are given, none are Cauchy] Frequently Ampère's original argument was simplified by making use of the "intuitively evident" fact that a function which varies continuously must be piecewise monotonic. Thus, differentiability and monotonicity were linked together, albeit tenuously. This is particularly interesting because Cauchy in his Leçons sur le calcul différentiel [1829] had considered the functions $f(x)=x^{3}\sin(1/x)$ and $g(x)=x\sin(1/x),$ both of which have removable discontinuities at $x=0$ and yet are not monotonic in any neighborhood of $0.$
[8] Philip Edward Bertrand Jourdain, The theory of functions with Cauchy and Gauß, Bibliotheca Mathematica (3) 6 (1905), 190-207.
I am including this because Boyer makes reference to Jourdain's discussion in Section 6 on p. 206. Jourdain's discussion mainly concerns the differentiability of functions of a complex variable. However, the nature of Jourdain's discussion, and especially the last sentence on p. 206 (which mentions the Weierstrass nowhere differentiable continuous function), suggests that Jourdain's discussion also concerns the differentiability of functions of a real variable.
(from p. 206, lines 5-14) In the memoir of 1825, CAUCHY required only one-valuedness and continuity of $f(z);$ whether he regarded continuity as sufficient for the existence of a derivative cannot be told from his writings, for, as for ["far" intended?] as I am aware, he nowhere made a pronouncement on this point, -- perhaps he did not regard such a pronouncement as necessary. But it is difficult to doubt, from other indications in CAUCHY's works, that CAUCHY imagined that his conception of 'continuity' was in any case sufficient for the 'geometrical representability' of a function, and so for the existence of a derivate [= derivative; Dini derivates are not considered anywhere in Jourdain's paper]. In fact, CAUCHY's conceptions in analysis rested on geometrical grounds (except at isolated points).
[9] Philip Edward Bertrand Jourdain, The origin of Cauchy's conceptions of a definite integral and of the continuity of a function, Isis 1 #4 (1913), 661-703.
(from Section XVIII, on pp. 701-702) But on the other hand, LACROIX (5) gave a «proof» of the existence of differential quotients. [footnote (5) gives a citation to pp. 241-242 of Volume I, and to p. 712 of Volume III] The first attempt of this kind was due to AMPÈRE. AMPÈRE (1) began a memoir on TAYLOR'S series by a «proof» that the function of $x$ and $i$ [namely] $[f(x+i)-f(x)]/i$ can become, when we put $i=0,$ neither zero nor infinite for all values of $x.$ [footnote (1) gives a citation to Ampère's 1806 paper] [several sentences omitted] A point which seems to be of very great interest is the implied supposition that $f(x)$ is continuous. Many authors, like DINI (3), REIFF (4) and PRINGSHEIM (5) just say that this proof is to apply to «continuous» functions, and do not add that the word «continuous» had a different meaning in 1806, and was not used by AMPÈRE. [(3) is a citation to pp. 67-68 & 219 of Dini's 1878 book Fondamenti per la Teorica delle Funzioni di Variabili Reali, (4) is a citation to p. 156 of Reiff's 1889 book Geschichte der Unendlichen Reihen, (5) is p. 449 of Pringsheim's 1890 paper Zur Geschichte des Taylorschen Lehrsatzes] The «proof» of the existence of the limit of the ratio $\; \frac{f(x')-f(x)}{x'-x} \;$ [typo corrected] given by LACROIX, was due to «M. BINET aîné, professeur de mathématiques transcendantes au Lycée de Rennes» (6). [footnote (6) extends to p. 703 and is the following: Presumably this would be the father of JACQUES PHILIPPE MARIE BINET who was born at Rennes in 1786 and died at Paris in 1856 (Poggendorff's biog.-lit. Handwörterbuch, vol. I, p. 194. For other early "proofs,, of the existence of derivatives, see GALOIS' (1830-1831) Œuvres, Paris, 1897, p. 9; DE MORGAN, Calculus, p. 47-48.]
Note: Augustus De Morgan's attempted proof that Jourdain mentions is not included among the 10 references given in a footnote on p. 44 of Hawkins' Lebesgue's Theory of Integration. Since De Morgan's book is fairly well known, I do not think Hawkins overlooked it. Instead, I think Hawkins did not include De Morgan's attempted proof because De Morgan expressed doubt about the proof in a paragraph (upper middle of p. 48) after his attempted proof.
[10] Morris Kline, Mathematical Thought from Ancient to Modern Times, Oxford University Press, 1972, xvii + 1238 pages. [Reprinted as a 3-volume paperback edition in 1990.]
Section 40.3. The Derivative (pp. 954-956 of the 1990 edition) includes the following.
(top of p. 955) Though Bolzano and Cauchy had rigorized (somewhat) the notions of continuity and the derivative, Cauchy and nearly all mathematicians of his era believed and many texts "proved" for the next fifty years that a continuous function must be differentiable (except of course at isolated points such as $x=0$ for $y=1/x).$
Note: This is perhaps not a very good example, since $y=1/x$ is not defined at $x=0.$ This manner of conflating (i.e. combining together) what we now consider to be two different ideas was common until the late 1800s. However, I do not know whether Kline is using this example to be in keeping with historical context or whether Kline simply overlooked the fact that his example could easily cause confusion with present-day readers.
[11] Morris Kline, Mathematics. The Loss of Certainty, Oxford University Press, 1980, viii + 366 pages.
(p. 176, lines 2-5) Like his contemporaries, he [= Cauchy] believed that continuity implied differentiability (Chapter VII) and so he stated many theorems in which the hypotheses called only for continuity, but where he used differentiability, and even after his attention was called to his mistake, he persisted.
Note: I cannot find anything in Kline's book to support this claim about "his attention was called to his mistake". There are no footnotes at the back of Kline's book and the next few pages do not re-visit this claim about Cauchy.
[12] Anatole Henri Ernest Lamarle, Étude approfondie sur les deux équations fondamentales Lim $\frac{f(x+h) - f(x)}{h} = f'(x)$ et $dy = f'(x).\;\Delta x$ [Extensive study of the two fundamental equations Lim $\frac{f(x+h) - f(x)}{h} = f'(x)$ and $dy = f'(x).\;\Delta x$], Mémoires de l'Académie Royale des Sciences, des Lettres et des Beaux-Arts de Belgique 29 (1855), 118 pages.
See also Lamarle's 1854 summary Note sur les deux équations fondamentales lim. $\frac{f(x+h) - f(x)}{h} = f'(x)$ et $dy = f'(x).\;\Delta x$ [Note on the two fundamental equations lim. $\frac{f(x+h) - f(x)}{h} = f'(x)$ and $dy = f'(x).\;\Delta x$] (22 pages) and Mathieu Schaar's 1854 6 page summary. For a 51 page biography of Lamarle (in French), with a bibliography of 40 items published by Lamarle, see Notice sur la vie et les travaux de A.-H.-E. Lamarle [Notice on the life and works of A.-H.-E. Lamarle].
[13] Jesper Lützen, The foundation of analysis in the 19th century, pp. 155-195 in Hans Niels Jahnke (editor), A History of Analysis, History of Mathematics #24, American Mathematical Society, 2003, x + 422 pages.
(from bottom of p. 169) In the definition of the derivative Cauchy [in his 1823 book] started out by assuming that $f$ is continuous, but having formed the difference quotient and its limit, he was cautious to state "if it exists". This seems to set the stage for the introduction of the concept of differentiability. However, Cauchy did not introduce this concept and in the subsequent chapters of his book he simply assumed that $f$ was continuous (or he assumed nothing), even though he differentiated it any number of times. It is as though Cauchy still clung to the 18th-century idea of a "safe domain" in which analysis was more or less universally valid. With Euler and d'Alembert this domain consisted of all functions; with Cauchy it consisted of the continuous functions.
(from p. 176, lines 17-19) Though Cauchy did not try to prove the erroneous theorem that any continuous function could be differentiated, he gave, as we have seen above, his readers the impression that it was true.
[14] Fyodor Andreyevich Medvedev, Scenes from the History of Real Functions, translation by Roger Lee Cooke of the 1975 Russian edition, Science Networks / Historical Studies #7, Birkhäuser Verlag, 1991, 265 pages.
Section 5.2 (Ampère's theorem, pp. 214-219) presents the viewpoint, which I agree with, that it is ahistorical (Medvedev, at least in translation, calls this "modernization") to interpret Ampère's paper as an attempt to prove that continuous functions are differentiable (except perhaps at certain isolated points).
(from middle of p. 216) It is difficult for the modern reader to judge the content of Ampère's main proposition and the methods of reasoning he used to prove it. The majority of authors who have written about this are for some reason inclined to believe that in this paper he was attempting to prove that a derivative exists everywhere [in a bounded interval] except at a finite number of points for any continuous function or at least for every continuous function satisfying certain supplementary restrictions$.^4$ [The footnote mentions F. Riesz writing in 1932 that Ampère may have had in mind piece-wise monotone functions.] This opinion can hardly be considered correct. After all, the concept of a continuous function as it is known today, cannot be dated earlier than Lobachevskii and Dirichlet (cf. Sec. 8 of Essay II), or at most to Bolzano (1817) and Cauchy (1821). Thus it is clear a priori that Ampère could not have stated any such general considerations about such functions in 1806, and in fact he makes no such statements. He himself nowhere says explicitly that the functions he is considering belong to any general class of functions, and any judgment as to what he had in mind must be based on indirect reasoning.
[15] Zbigniew Piotrowski, The genesis of separate versus joint continuity, Tatra Mountains Mathematical Publications 8 (1996), 113-126.
(from middle of p. 115) Like his contemporaries, he [= Cauchy] also believed that continuity implied differentiability (?!) (see Chapter VII of [Ca]), and even after his attention was called to his mistake, he ... persisted (compare [K2] p. 176).
Note: [Ca] is Cauchy's 1821 Cours d'Analyse and [K2] is Kline's book Mathematics. The Loss of Certainty. The ellipsis "..." is in the original and it does not indicate that I have omitted something while quoting from Piotrowski's paper.
[16] Avadhesh [Avaresh] Narayan Singh, The Theory and Construction of Non-Differentiable Functions, Lucknow University Studies #1, Newul Kishore Press [Lucknow University Press], 1935, vii + 110 pages. [Reprinted in Squaring the Circle and Other Monographs, Chelsea Publishing Company, 1953.]
(from First Lecture, Article 4: 2nd paragraph on pp. 4-5) [(1) and (30) are bibliographic citations in Singh's 104 item bibliography, and they refer to Ampère's 1806 paper and Gilbert's 1873 paper.] An attempt to prove that continuity was a sufficient condition for differentiability was made by Ampère (1) in 1806. Although Ampère's proof was defective yet his result was believed in by most mathematicians for a long time. Mention may be made of Duhamel, Bertrand and Gilbert (30) among those who definitely expressed their belief in Ampère's result. Even in the writings of such eminent mathematicians as Gauss, Cauchy, and Dirichlet there is nothing to show that they held a different opinion. Although they did not endorse Ampère's statement none of them seems to have had the conviction that a function which was everywhere continuous but nowhere differentiable could exist. Darboux in his memoir on "Discontinuous functions," published in 1875, mentions only one auditor, M. Bienaimé, who said that he was unconvinced by Ampére's proof.
[17] Klaus Thomas Volkert, Zur differenzierbarkeit stetiger funktionen -- Ampère's beweis und seine folgen [On differentiability of continuous functions -- Ampère's proof and its consequences], Archive for History of Exact Sciences 40 #1 (March 1989), 37-112.
This appears to be a very complete study of Ampère's 1806 paper and its influence on later efforts by Lamarle, Hankel, Gilbert, du Bois-Reymond, Dini, and others. Unfortunately, the paper is in German and I cannot read German, and there seems to be nothing on the internet (at least, nothing freely available) that discusses (in English) Volkert's paper.