HTTPIE CURL and WGET

by Anish

---

Posted on Tuesday October 1st 2019

---

---

Utilities are essentials for working with HTTP methods many such utilities exist which eases our daily Job. In this tutorial we will go to some of the practical use-case of handling HTTP methods which can be used in our daily life to increase our productivity and cover the below utilities

• httpie: Client-side implementation of the HTTP/1.1 protocol
• curl: transfer a URL
• wget : The non-interactive network downloader

For Docker user can pull the Image

docker pull anishnath/httpclient

Fetch the headers only

• http

# http 8gwifi.org
HTTP/1.1 301 Moved Permanently
CF-RAY: 51ec3d603adbce2b-LHR
.......
.......
Vary: Accept-Encoding

• curl

# curl -I 8gwifi.org
/httpclient # curl -I 8gwifi.org
HTTP/1.1 301 Moved Permanently
........
........
Connection: keep-alive

HTTP Methods

POST

HTTP POST With content-type: application/x-www-form-urlencoded

curl -X POST \
  https://8gwifi.org/crypto/rest/encryptdecrypt/encrypt \
  -H 'content-type: application/x-www-form-urlencoded' \
  -d 'p_msg=Hello%208gwifi.org&p_secretkey=a23c6e1a4aa987e766ecad497f2f4166fb4117b64adfb8bc&p_cipher=AES_128%2FCFB%2FNOPADDING'

http --form POST https://8gwifi.org/crypto/rest/encryptdecrypt/encrypt \
  content-type:application/x-www-form-urlencoded \
  p_msg='Hello 8gwifi.org' \
  p_secretkey=a23c6e1a4aa987e766ecad497f2f4166fb4117b64adfb8bc \
  p_cipher=AES_128/CFB/NOPADDING

wget --quiet \
  --method POST \
  --header 'content-type: application/x-www-form-urlencoded' \
  --body-data 'p_msg=Hello%208gwifi.org&p_secretkey=a23c6e1a4aa987e766ecad497f2f4166fb4117b64adfb8bc&p_cipher=AES_128%2FCFB%2FNOPADDING' \
  --output-document \
  - https://8gwifi.org/crypto/rest/encryptdecrypt/encrypt

HTTP POST with multipart/form-data

• curl

curl --request POST \
  --url https://0cloud0.com/ \
  --header 'content-type: multipart/form-data; boundary=----WebKitFormBoundary7MA4YWxkTrZu0gW' \
  --form hello=21

• http

echo '------WebKitFormBoundary7MA4YWxkTrZu0gW
Content-Disposition: form-data; name="hello"

21
------WebKitFormBoundary7MA4YWxkTrZu0gW--' |  \
  http POST https://8gwifi.org/crypto/rest/encryptdecrypt/encrypt \
  content-type:'multipart/form-data; boundary=----WebKitFormBoundary7MA4YWxkTrZu0gW'

• wget

wget --quiet \
  --method POST \
  --header 'content-type: multipart/form-data; boundary=----WebKitFormBoundary7MA4YWxkTrZu0gW' \
  --body-data '------WebKitFormBoundary7MA4YWxkTrZu0gW\r\nContent-Disposition: form-data; name="hello"\r\n\r\n21\r\n------WebKitFormBoundary7MA4YWxkTrZu0gW--' \
  --output-document \
  - https://0cloud0.com/ 

HTTP POST with application/json

• http

echo '{
  "id": 1,
  "name": "JSON DEMO"
}' |  \
  http POST https://example.com \
  content-type:application/json

• curl

curl --request POST \
  --url https://example.com \
  --header 'content-type: application/json' \
  --data '{\n  "id": 1,\n  "name": "JSON DEMO"\n}'

• wget

wget --quiet \
  --method POST \
  --header 'content-type: application/json' \
  --body-data '{\n  "id": 1,\n  "name": "JSON DEMO"\n}' \
  --output-document \
  - https://example.com

HTTP POST with application/xml

• wget

wget --quiet \
  --method POST \
  --header 'content-type: application/xml' \
  --body-data '<xml>\n  <heading>XML Demo</heading>\n</xml>' \
  --output-document \
  - https://example.com

• http

  echo '<xml>
  <heading>XML Demo</heading>
</xml>' |  \
  http POST https://example.com \
  content-type:application/xml 

• curl

 curl --request POST \
  --url https://example.com \
  --header 'cache-control: no-cache' \
  --header 'content-type: application/xml' \
  --data '<xml>\n  <heading>XML Demo</heading>\n</xml>'

PATCH

A HTTP patch operation with required headers

• http

http PATCH https://api.cloudflare.com/client/v4 \
  x-auth-email:anish2g[email protected] \
  x-auth-key:1b2c4be9f9432d53e0cfbc61439de679

• curl

curl --request PATCH \
  --url https://api.cloudflare.com/client/v4 \
  --header 'x-auth-email: [email protected]' \
  --header 'x-auth-key: 1b2c4be9f9432d53e0cfbc61439de679'

• wget

wget --quiet \
  --method PATCH \
  --header 'x-auth-email: email_id' \
  --header 'x-auth-key: 1b2c4be9f9432d53e0cfbc61439de679' \
  --output-document \
  - https://api.cloudflare.com/client/v4

Authentication

• Basic auth

http -a username:password http://8gwifi.org

curl

curl -u username:password http://8gwifi.org
curl --header "Authorization: Basic $AUTH" http://8gwifi.org

wget

wget  \
  --method GET \
  --header 'authorization: Basic YW5pc2g6YW5pc2g=' \
  - https://0cloud0.com/

• Authorization Bearer

curl --header "Authorization: Bearer $TOKEN" http://8gwifi.org

• Digest auth

http -A digest -a username:password https://0cloud0.com
curl --digest --user username:password https://0cloud0.com

• NTLM

curl --ntlm --user username:password https://0cloud0.com

• Negotiate

curl --negotiate --user username:password https://0cloud0.com

• Password prompt
  http -a username https://0cloud0.com

TLS Handling

Allow Insecure connection

curl  -k https://example.com

Client certificate Validation

curl  -E  wk.cert  https://example.com

Use Specfic TLS version to Connect

# curl  -I --tlsv1.3 https://msn.com
curl: (35) OpenSSL SSL_connect: SSL_ERROR_SYSCALL in connection to msn.com:443 

# curl  -I --tlsv1.2 https://msn.com
HTTP/1.1 301 Moved Permanently
Content-Length: 143
Content-Type: text/html; charset=UTF-8
Location: https://www.msn.com/
Server: Microsoft-IIS/8.5
X-Powered-By: ASP.NET
Date: Tue, 01 Oct 2019 10:39:40 GMT

http --ssl tls1.2  https://msn.com

Download File

• http

# http --download  https://8gwifi.org/docs/img/6book.png

Downloading 167.86 kB to "6book.png"
Done. 167.86 kB in 0.39169s (428.57 kB/s)

• curl

# curl https://8gwifi.org/docs/img/6book.png --output myfile.png
% Total  % Received % Xferd  Average Speed Time  Time Time  Current
Dload  Upload Total Spent  Left  Speed
100  167k  100  167k  0 0 168k  0 --:--:-- --:--:-- --:--:--  167k

• wget

wget https://8gwifi.org/docs/img/6book.png

Silent Download

curl https://8gwifi.org/docs/img/6book.png --output myfile.png -s

Follow 30x Location redirects

• curl

# curl -L -I http://8gwifi.org

HTTP/1.1 301 Moved Permanently
........
........
Connection: keep-alive

HTTP/2 200 
............
.............
cf-ray: 51ed29d20f79bb94-LHR

If you have any more Idea Please paste on comments I will add this on the List with your Name

Next Reading : How to Monitoring All Executed Commands in Linux

---

---

Thanku for reading !!! Give a Share for Support

Asking for donation sound bad to me, so i'm raising fund from by offering all my Nine book for just $9

---