BigNet (Networking & Scraping)
BigNet allows your scripts to communicate with the internet, fetch data, and scrape websites.
1. HTTP Requests
GET (Fetching)
Download text or HTML from a URL.
Syntax: get web "[URL]" & set as {[Variable]}
get web "https://bigc.org" & set as {Response}
POST (Sending Data)
Send data to an API or server.
Syntax: get post "[URL]" with "[Data]" & set as {[Variable]}
get post "https://api.com/login" with "user=admin" & set as {Response}
2. Scraping (Look For)
Use look for to extract specific information from a block of HTML text. It uses standard CSS Selectors and the @ Target symbol.
Syntax: look for "[Selector]" @[Source] & set as {[Variable]}
- Selector: The CSS path (e.g.,
h1,.price,#title). - @: The Target symbol (points to the variable containing HTML).
Example:
get web "https://news.com" & set as {Response}
look for "h1" @Response & set as {Headline}
print "Today's News: $Headline"
3. JSON Parsing
If you are working with an API that returns JSON, use the json keyword as a modifier before the key.
Syntax: look for json "[Key]" @[Source] & set as {[Variable]}
get web "https://api.com/user/1" & set as {Response}
look for json "username" @Response & set as {User}
print "User is: $User"
4. Configuration (Proxies & Agents)
Set these at the top of your script to hide your identity or bypass restrictions.
- User-Agent:
user-agent "Mozilla/5.0..." - Proxy:
proxy "http://user:pass@host:port" - Headers:
header "Authorization" "Bearer token"