HTTPIE CURL and WGET

Posted on Tuesday October 1st 2019

Utilities are essentials for working with HTTP methods many such utilities exist which eases our daily Job. In this tutorial we will go to some of the practical use-case of handling HTTP methods which can be used in our daily life to increase our productivity and cover the below utilities

httpie: Client-side implementation of the HTTP/1.1 protocol
curl: transfer a URL
wget : The non-interactive network downloader

For Docker user can pull the Image

docker pull anishnath/httpclient

Fetch the headers only

http

# http 8gwifi.org
HTTP/1.1 301 Moved Permanently
CF-RAY: 51ec3d603adbce2b-LHR
.......
.......
Vary: Accept-Encoding

curl

# curl -I 8gwifi.org
/httpclient # curl -I 8gwifi.org
HTTP/1.1 301 Moved Permanently
........
........
Connection: keep-alive

HTTP Methods

POST

HTTP POST With content-type: application/x-www-form-urlencoded

curl -X POST \
  https://8gwifi.org/crypto/rest/encryptdecrypt/encrypt \
  -H 'content-type: application/x-www-form-urlencoded' \
  -d 'p_msg=Hello%208gwifi.org&p_secretkey=a23c6e1a4aa987e766ecad497f2f4166fb4117b64adfb8bc&p_cipher=AES_128%2FCFB%2FNOPADDING'

http --form POST https://8gwifi.org/crypto/rest/encryptdecrypt/encrypt \
  content-type:application/x-www-form-urlencoded \
  p_msg='Hello 8gwifi.org' \
  p_secretkey=a23c6e1a4aa987e766ecad497f2f4166fb4117b64adfb8bc \
  p_cipher=AES_128/CFB/NOPADDING

wget --quiet \
  --method POST \
  --header 'content-type: application/x-www-form-urlencoded' \
  --body-data 'p_msg=Hello%208gwifi.org&p_secretkey=a23c6e1a4aa987e766ecad497f2f4166fb4117b64adfb8bc&p_cipher=AES_128%2FCFB%2FNOPADDING' \
  --output-document \
  - https://8gwifi.org/crypto/rest/encryptdecrypt/encrypt

HTTP POST with multipart/form-data

curl

curl --request POST \
  --url https://0cloud0.com/ \
  --header 'content-type: multipart/form-data; boundary=----WebKitFormBoundary7MA4YWxkTrZu0gW' \
  --form hello=21

http

echo '------WebKitFormBoundary7MA4YWxkTrZu0gW
Content-Disposition: form-data; name="hello"

21
------WebKitFormBoundary7MA4YWxkTrZu0gW--' |  \
  http POST https://8gwifi.org/crypto/rest/encryptdecrypt/encrypt \
  content-type:'multipart/form-data; boundary=----WebKitFormBoundary7MA4YWxkTrZu0gW'

wget

wget --quiet \
  --method POST \
  --header 'content-type: multipart/form-data; boundary=----WebKitFormBoundary7MA4YWxkTrZu0gW' \
  --body-data '------WebKitFormBoundary7MA4YWxkTrZu0gW\r\nContent-Disposition: form-data; name="hello"\r\n\r\n21\r\n------WebKitFormBoundary7MA4YWxkTrZu0gW--' \
  --output-document \
  - https://0cloud0.com/

HTTP POST with application/json

http

echo '{
  "id": 1,
  "name": "JSON DEMO"
}' |  \
  http POST https://example.com \
  content-type:application/json

curl

curl --request POST \
  --url https://example.com \
  --header 'content-type: application/json' \
  --data '{\n  "id": 1,\n  "name": "JSON DEMO"\n}'

wget

wget --quiet \
  --method POST \
  --header 'content-type: application/json' \
  --body-data '{\n  "id": 1,\n  "name": "JSON DEMO"\n}' \
  --output-document \
  - https://example.com

HTTP POST with application/xml

wget

wget --quiet \
  --method POST \
  --header 'content-type: application/xml' \
  --body-data '<xml>\n  <heading>XML Demo</heading>\n</xml>' \
  --output-document \
  - https://example.com

http

  echo '<xml>
  <heading>XML Demo</heading>
</xml>' |  \
  http POST https://example.com \
  content-type:application/xml

curl

 curl --request POST \
  --url https://example.com \
  --header 'cache-control: no-cache' \
  --header 'content-type: application/xml' \
  --data '<xml>\n  <heading>XML Demo</heading>\n</xml>'

PATCH

A HTTP patch operation with required headers

http

http PATCH https://api.cloudflare.com/client/v4 \
  x-auth-email:[email protected] \
  x-auth-key:1b2c4be9f9432d53e0cfbc61439de679

curl

curl --request PATCH \
  --url https://api.cloudflare.com/client/v4 \
  --header 'x-auth-email: [email protected]' \
  --header 'x-auth-key: 1b2c4be9f9432d53e0cfbc61439de679'

wget

wget --quiet \
  --method PATCH \
  --header 'x-auth-email: email_id' \
  --header 'x-auth-key: 1b2c4be9f9432d53e0cfbc61439de679' \
  --output-document \
  - https://api.cloudflare.com/client/v4

Authentication

Basic auth

http -a username:password http://8gwifi.org

curl

curl -u username:password http://8gwifi.org
curl --header "Authorization: Basic $AUTH" http://8gwifi.org

wget

wget  \
  --method GET \
  --header 'authorization: Basic YW5pc2g6YW5pc2g=' \
  - https://0cloud0.com/

Authorization Bearer

curl --header "Authorization: Bearer $TOKEN" http://8gwifi.org

Digest auth

http -A digest -a username:password https://0cloud0.com
curl --digest --user username:password https://0cloud0.com

NTLM

curl --ntlm --user username:password https://0cloud0.com

Negotiate

curl --negotiate --user username:password https://0cloud0.com

Password prompt
http -a username https://0cloud0.com

TLS Handling

Allow Insecure connection

curl  -k https://example.com

Client certificate Validation

curl  -E  wk.cert  https://example.com

Use Specfic TLS version to Connect

# curl  -I --tlsv1.3 https://msn.com
curl: (35) OpenSSL SSL_connect: SSL_ERROR_SYSCALL in connection to msn.com:443

# curl  -I --tlsv1.2 https://msn.com
HTTP/1.1 301 Moved Permanently
Content-Length: 143
Content-Type: text/html; charset=UTF-8
Location: https://www.msn.com/
Server: Microsoft-IIS/8.5
X-Powered-By: ASP.NET
Date: Tue, 01 Oct 2019 10:39:40 GMT

http --ssl tls1.2  https://msn.com

Download File

http

# http --download  https://8gwifi.org/docs/img/6book.png

Downloading 167.86 kB to "6book.png"
Done. 167.86 kB in 0.39169s (428.57 kB/s)

curl

# curl https://8gwifi.org/docs/img/6book.png --output myfile.png
% Total  % Received % Xferd  Average Speed Time  Time Time  Current
Dload  Upload Total Spent  Left  Speed
100  167k  100  167k  0 0 168k  0 --:--:-- --:--:-- --:--:--  167k

wget

wget https://8gwifi.org/docs/img/6book.png

Silent Download

curl https://8gwifi.org/docs/img/6book.png --output myfile.png -s

Follow 30x Location redirects

curl

# curl -L -I http://8gwifi.org

HTTP/1.1 301 Moved Permanently
........
........
Connection: keep-alive

HTTP/2 200 
............
.............
cf-ray: 51ed29d20f79bb94-LHR

If you have any more Idea Please paste on comments I will add this on the List with your Name

Next Reading : How to Monitoring All Executed Commands in Linux

Thanku for reading !!! Give a Share for Support

Your Support Matters!

Instead of directly asking for donations, I'm thrilled to offer you all nine of my books for just $9 on leanpub By grabbing this bundle you not only help cover my coffee, beer, and Amazon bills but also play a crucial role in advancing and refining this project. Your contribution is indispensable, and I'm genuinely grateful for your involvement in this journey!

Any private key value that you enter or we generate is not stored on this site, this tool is provided via an HTTPS URL to ensure that private keys cannot be stolen, for extra security run this software on your network, no cloud dependency