[PATCH] block: Handle curl 7.55.0, 7.85.0 version changes

Anton Johansson via posted 1 patch 1 year, 2 months ago
block/curl.c | 44 +++++++++++++++++++++++++++++++++++++-------
1 file changed, 37 insertions(+), 7 deletions(-)
[PATCH] block: Handle curl 7.55.0, 7.85.0 version changes
Posted by Anton Johansson via 1 year, 2 months ago
* 7.55.0 deprecates CURLINFO_CONTENT_LENGTH_DOWNLOAD in favour of a *_T
  version, which returns curl_off_t instead of a double.
* 7.85.0 deprecates CURLOPT_PROTOCOLS and CURLOPT_REDIR_PROTOCOLS in
  favour of *_STR variants, specifying the desired protocols via a
  string.

Signed-off-by: Anton Johansson <anjo@rev.ng>
---
 block/curl.c | 44 +++++++++++++++++++++++++++++++++++++-------
 1 file changed, 37 insertions(+), 7 deletions(-)

diff --git a/block/curl.c b/block/curl.c
index cba4c4cac7..0b125095e3 100644
--- a/block/curl.c
+++ b/block/curl.c
@@ -37,8 +37,15 @@
 
 // #define DEBUG_VERBOSE
 
+/* CURL 7.85.0 switches to a string based API for specifying
+ * the desired protocols.
+ */
+#if LIBCURL_VERSION_NUM >= 0x075500
+#define PROTOCOLS "HTTP,HTTPS,FTP,FTPS"
+#else
 #define PROTOCOLS (CURLPROTO_HTTP | CURLPROTO_HTTPS | \
                    CURLPROTO_FTP | CURLPROTO_FTPS)
+#endif
 
 #define CURL_NUM_STATES 8
 #define CURL_NUM_ACB    8
@@ -509,9 +516,18 @@ static int curl_init_state(BDRVCURLState *s, CURLState *state)
          * obscure protocols.  For example, do not allow POP3/SMTP/IMAP see
          * CVE-2013-0249.
          *
-         * Restricting protocols is only supported from 7.19.4 upwards.
+         * Restricting protocols is only supported from 7.19.4 upwards. Note:
+         * version 7.85.0 deprecates CURLOPT_*PROTOCOLS in favour of a string
+         * based CURLOPT_*PROTOCOLS_STR API.
          */
-#if LIBCURL_VERSION_NUM >= 0x071304
+#if LIBCURL_VERSION_NUM >= 0x075500
+        if (curl_easy_setopt(state->curl,
+                             CURLOPT_PROTOCOLS_STR, PROTOCOLS) ||
+            curl_easy_setopt(state->curl,
+                             CURLOPT_REDIR_PROTOCOLS_STR, PROTOCOLS)) {
+            goto err;
+        }
+#elif LIBCURL_VERSION_NUM >= 0x071304
         if (curl_easy_setopt(state->curl, CURLOPT_PROTOCOLS, PROTOCOLS) ||
             curl_easy_setopt(state->curl, CURLOPT_REDIR_PROTOCOLS, PROTOCOLS)) {
             goto err;
@@ -669,7 +685,12 @@ static int curl_open(BlockDriverState *bs, QDict *options, int flags,
     const char *file;
     const char *cookie;
     const char *cookie_secret;
-    double d;
+    /* CURL >= 7.55.0 uses curl_off_t for content length instead of a double */
+#if LIBCURL_VERSION_NUM >= 0x073700
+    curl_off_t cl;
+#else
+    double cl;
+#endif
     const char *secretid;
     const char *protocol_delimiter;
     int ret;
@@ -796,27 +817,36 @@ static int curl_open(BlockDriverState *bs, QDict *options, int flags,
     }
     if (curl_easy_perform(state->curl))
         goto out;
-    if (curl_easy_getinfo(state->curl, CURLINFO_CONTENT_LENGTH_DOWNLOAD, &d)) {
+    /* CURL 7.55.0 deprecates CURLINFO_CONTENT_LENGTH_DOWNLOAD in favour of
+     * the *_T version which returns a more sensible type for content length.
+     */
+#if LIBCURL_VERSION_NUM >= 0x073700
+    if (curl_easy_getinfo(state->curl, CURLINFO_CONTENT_LENGTH_DOWNLOAD_T, &cl)) {
+        goto out;
+    }
+#else
+    if (curl_easy_getinfo(state->curl, CURLINFO_CONTENT_LENGTH_DOWNLOAD, &cl)) {
         goto out;
     }
+#endif
     /* Prior CURL 7.19.4 return value of 0 could mean that the file size is not
      * know or the size is zero. From 7.19.4 CURL returns -1 if size is not
      * known and zero if it is really zero-length file. */
 #if LIBCURL_VERSION_NUM >= 0x071304
-    if (d < 0) {
+    if (cl < 0) {
         pstrcpy(state->errmsg, CURL_ERROR_SIZE,
                 "Server didn't report file size.");
         goto out;
     }
 #else
-    if (d <= 0) {
+    if (cl <= 0) {
         pstrcpy(state->errmsg, CURL_ERROR_SIZE,
                 "Unknown file size or zero-length file.");
         goto out;
     }
 #endif
 
-    s->len = d;
+    s->len = cl;
 
     if ((!strncasecmp(s->url, "http://", strlen("http://"))
         || !strncasecmp(s->url, "https://", strlen("https://")))
-- 
2.39.0
Re: [PATCH] block: Handle curl 7.55.0, 7.85.0 version changes
Posted by Peter Maydell 1 year, 2 months ago
On Mon, 23 Jan 2023 at 20:15, Anton Johansson via <qemu-devel@nongnu.org> wrote:
>
> * 7.55.0 deprecates CURLINFO_CONTENT_LENGTH_DOWNLOAD in favour of a *_T
>   version, which returns curl_off_t instead of a double.
> * 7.85.0 deprecates CURLOPT_PROTOCOLS and CURLOPT_REDIR_PROTOCOLS in
>   favour of *_STR variants, specifying the desired protocols via a
>   string.
>
> Signed-off-by: Anton Johansson <anjo@rev.ng>

Block folks -- this patch has been reviewed, are you going to
pick it up (with the Resolves: line added) ?

I'm interested because one of the machines I use has just updated
to the new libcurl and so QEMU no longer compiles there because
of the deprecation warnings :-)

-- PMM
Re: [PATCH] block: Handle curl 7.55.0, 7.85.0 version changes
Posted by Kevin Wolf 1 year, 2 months ago
Am 13.02.2023 um 14:28 hat Peter Maydell geschrieben:
> On Mon, 23 Jan 2023 at 20:15, Anton Johansson via <qemu-devel@nongnu.org> wrote:
> >
> > * 7.55.0 deprecates CURLINFO_CONTENT_LENGTH_DOWNLOAD in favour of a *_T
> >   version, which returns curl_off_t instead of a double.
> > * 7.85.0 deprecates CURLOPT_PROTOCOLS and CURLOPT_REDIR_PROTOCOLS in
> >   favour of *_STR variants, specifying the desired protocols via a
> >   string.
> >
> > Signed-off-by: Anton Johansson <anjo@rev.ng>
> 
> Block folks -- this patch has been reviewed, are you going to
> pick it up (with the Resolves: line added) ?

Yes, I'm going through the patches right now that were stuck because the
previous pull request was blocked by CI.

Thanks, applied to the block branch.

Kevin
Re: [PATCH] block: Handle curl 7.55.0, 7.85.0 version changes
Posted by Alex Bennée 1 year, 1 month ago
Kevin Wolf <kwolf@redhat.com> writes:

> Am 13.02.2023 um 14:28 hat Peter Maydell geschrieben:
>> On Mon, 23 Jan 2023 at 20:15, Anton Johansson via <qemu-devel@nongnu.org> wrote:
>> >
>> > * 7.55.0 deprecates CURLINFO_CONTENT_LENGTH_DOWNLOAD in favour of a *_T
>> >   version, which returns curl_off_t instead of a double.
>> > * 7.85.0 deprecates CURLOPT_PROTOCOLS and CURLOPT_REDIR_PROTOCOLS in
>> >   favour of *_STR variants, specifying the desired protocols via a
>> >   string.
>> >
>> > Signed-off-by: Anton Johansson <anjo@rev.ng>
>> 
>> Block folks -- this patch has been reviewed, are you going to
>> pick it up (with the Resolves: line added) ?
>
> Yes, I'm going through the patches right now that were stuck because the
> previous pull request was blocked by CI.
>
> Thanks, applied to the block branch.

I've also applied to my testing/next (for the same reason) just in case
the block branch doesn't go in soon.

-- 
Alex Bennée
Virtualisation Tech Lead @ Linaro
Re: [PATCH] block: Handle curl 7.55.0, 7.85.0 version changes
Posted by Peter Maydell 1 year, 2 months ago
On Mon, 23 Jan 2023 at 20:15, Anton Johansson via <qemu-devel@nongnu.org> wrote:
>
> * 7.55.0 deprecates CURLINFO_CONTENT_LENGTH_DOWNLOAD in favour of a *_T
>   version, which returns curl_off_t instead of a double.
> * 7.85.0 deprecates CURLOPT_PROTOCOLS and CURLOPT_REDIR_PROTOCOLS in
>   favour of *_STR variants, specifying the desired protocols via a
>   string.
>
> Signed-off-by: Anton Johansson <anjo@rev.ng>

We should note that this
Resolves: https://gitlab.com/qemu-project/qemu/-/issues/1440

There also seems to be a different set of patches that
somebody attached to that bug report, but yours wins
since you actually submitted it :-)

thanks
-- PMM
Re: [PATCH] block: Handle curl 7.55.0, 7.85.0 version changes
Posted by Philippe Mathieu-Daudé 1 year, 2 months ago
On 23/1/23 21:14, Anton Johansson via wrote:
> * 7.55.0 deprecates CURLINFO_CONTENT_LENGTH_DOWNLOAD in favour of a *_T
>    version, which returns curl_off_t instead of a double.
> * 7.85.0 deprecates CURLOPT_PROTOCOLS and CURLOPT_REDIR_PROTOCOLS in
>    favour of *_STR variants, specifying the desired protocols via a
>    string.
> 
> Signed-off-by: Anton Johansson <anjo@rev.ng>
> ---
>   block/curl.c | 44 +++++++++++++++++++++++++++++++++++++-------
>   1 file changed, 37 insertions(+), 7 deletions(-)

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>