Server :: Using WGET And Escaping URL With Query String?
Jul 12, 2010
There is a partnering website that provides an RSS feed to display on the website I am working on. The website displays information on the feed every time a user accesses the website. The feed changes almost every day. For bandwidth considerations and speed, I would like to download the feed once by the server using a crontab job (my website is in a linux shared hosting environment). The problem exists with the URL structure, which I have no control over.
Here is the URL:
Code:
[code]....
I am aware that there are characters that need escaping and this is where I am getting my errors. I have never written a shell-script but I am also assuming some of the characters are keywords in the Shell Scripting language or Linux I am also aware that I can avoid having to escape by enclosing the URL with single or double quotes. You will notice that the URL has BOTH single and double quotes, so its not as simple.
View 1 Replies
ADVERTISEMENT
Nov 30, 2010
Index of /distribution/openSUSE-stable/repo/oss/suse/i586 How can i download packages with wget from that mirror with a string "alsa"?
Such as:
alsa-1.0.23-2.12.i586.rpm
alsa-devel-1.0.23-2.12.i586.rpm
alsa-oss-1.0.17-29.2.i586.rpm
View 9 Replies
View Related
Oct 22, 2010
copy string a to string b and change string b with toupper() and count the chars
View 3 Replies
View Related
Feb 19, 2010
The issue is that my CentOS workstation is in a vlan from where the Intranet's DNS servers are unreachable. For browsing the web there is an ISA proxy server, which I presume resolves DNS for my firefox. However, wget, host, ping and aria2c fail to get any sort of DNS resolution since they're being run from command line.I have exported HTTP_PROXY value, which provides me internet access on console, but,only when I connect using IP address. It fails on name resolution.
My question is:May I redirect the DNS queries to my home PC which would be running a DNS server on a non standard port?I was thinking of putting nameserver 127.0.0.1 in /etc/resolv.conf and then put iptables rule to redirect 127.0.0.1:53 UDP to a.public.ip.address:3535 UDP..I don't know if I am shooting blanks or what, I am not very much aware of this kind of setup.My main need is to provide DNS resolution to console apps.I want to utilize my company's idle bandwidth for bulk downloads, so, using proxy, SSH tunneling through my Home PC is out of question.
View 8 Replies
View Related
Nov 2, 2010
i want to replace
Code: <trus.analytics.platform.model.version>2.0.0-SNAPSHOT</trus.analytics.platform.model.version> with
Code: <trus.analytics.platform.model.version>2.0.0-b-20</trus.analytics.platform.model.version> using sed command. Code: sed -i
[Code]....
I think there is a problem with front-slash but not sure how to resolve it.
View 2 Replies
View Related
Nov 18, 2010
What I have done wrong with my escaping here:
Code:
The original filename is:
Code:
View 4 Replies
View Related
Dec 12, 2010
I know it is pretty trivial but anyway...I have php file that I am trying to read it looks like this
...
add_item_tabulky("Klaun-PF 2011","klaun_pf2011.jpg","","","");
add_item_tabulky("Pras�tko-�ťastn�
[code]...
View 3 Replies
View Related
Feb 3, 2011
We have 2 servers, 1 is the webserver and the other is the Mysql server.
When transfering a 2GB file from the webserver to the Mysql server.
The webserver's connection to the mysql DB server dies completely.
Need to restart the MYSQL process in order for it to come back online.
During this connection downtime, when using phpmyadmin on the mysql server shows no problem running queries etc.
View 2 Replies
View Related
Aug 17, 2010
Been hunting around and trying this for a few days now, without any success.I have configured a CentOS 5.5 box to start up named on boot. I have a Windows 7 machine currently going straight to the router for its DNS, that I want to point to this box instead.While I have done all the tests on the Linux box, and everything says it's working, my Windows 7 box just can't seem to contact the named service.While I am certain that my firewalls are configured correctly ( as I was able to connect through with Cyberkit on the other ports that are open ), I have even switched off the firewalls on both machines entirely to rule them out. And they still can't connect.
View 3 Replies
View Related
Jun 19, 2011
If a wget download is interrupted (like if I have to shutdown prematurely), I get a wget.log with the partial download. How can I later resume the download using the data in wget.log? I have searched high and low (including wget manual) and cannot find how to do this. Is it so obvious that I did not see it? The wget -c option with the wget.log as the argument to the -c option does not work. What I do do is open the wget.log and copy the URL and then paste it into the command line and do another wget. This works but the download is started from the beginning, which means nothing in the wget.log is used.
View 2 Replies
View Related
Aug 4, 2010
I configured ldap server & client on centos,then i connected centos and suse with network.now want to get group of any user from this server via suse.is it possible with perl scripts? or i need to install other modules on suse or centos?(such as : pam,nss)
View 8 Replies
View Related
Jan 4, 2010
I am working one project and i want to know that is it possible to find out the DNS (BIND) QPS (query per second). I mean how many QPS BIND can handle.
View 2 Replies
View Related
Jul 21, 2010
There is probably a very simple fix, but its wrecking my buzzI call the following on the command lineR CMD BATCH '--args Y_filename="one.txt" out="two.txt"' brew.RI want to call this from a bash script but replace one.txt with $1, and two.txt with $2 (ie the first two arguments from the command line)I have tried in vane"R CMD BATCH '--args Y_filename="$1" out="$2"' brew.R"
View 8 Replies
View Related
Jun 16, 2010
I'm trying to setup a linux box to act as just a DNS server. Its something I'd like to use just for WAN type requests and leave other domain related things to the Server running WIndows.At this point on my Linux box, I can run queries and nslookups from it. I can not however, from a Windows box, run a NSLOOKUP command from the Linux box which is telling me to check the permissions from Linux to enable that for the clients. It's enabled.From a C: I type in nslookup - *ip of Linux box* and it tells me -- Can't find server name for address.
View 4 Replies
View Related
Nov 4, 2010
i have a server which was handover me, it has redhat 4 u3.but i cant find the machine model no, it is hp g4 server, so this info from linux where can i see
2nd if i want to know what is the bios version and date how can i see from linux.
3rd if any hardware failing like network card, ram memory, hard disk how we come to know hardware.
View 5 Replies
View Related
Jan 28, 2010
i have MySQL on my CentOS server and have installed it and got it up and running through the command line.
I have changed root's username and password so there is no user called 'root' anymore. I also created a database called pancakes.Now when i try to log in using Query Browser, i put the server's IP in 'hostname', my new roots username and password in 'username' and 'password'.When i try to log in it gives me error 1130 and says connection from myhostname not allowed.
View 6 Replies
View Related
Dec 30, 2010
I have a ClarkConnect (CentOS based) box running as my home router on a RR connection. I had the DNS servers set up to use Google's DNS server. I want to change them back to the local DNS servers but I can't find an obvious/easy way to get those address short of a) reconfiguring the router's network to DHCP them (would rather not interrupt everyone) or b) calling their tech support (kill me now!). Is there a command line tool/command I can use to query the DHCP server on the external NIC to see what DNS servers it would set me up with w/o munging my existing setup?
View 1 Replies
View Related
May 19, 2010
We've got crontabs set up in /etc/cron.d to run various things, and we have them running as a specific local user.
Watching the LDAP logs, I can see the servers in question making requests for that username to the LDAP server every time cron runs, even though that user isn't in LDAP and is only local. nsswitch is configured to do "files ldap" as well.
The constant stream of LDAP queries is killing LDAP and making it impossible to log into our boxes.
why cron is querying LDAP for a local user?
View 1 Replies
View Related
Mar 8, 2010
I have installed mysql package in ubuntu 9.04 .I have also installed the query browser software can someone tell me how to configure the connection dialogue box in query browser. also my friend is using ubuntu 8.04 when he writes mysql in terminal he can directly execute database queries there but when i try the same thing on 9.04 i get an error as "Access denied for user 'ravi'@'localhost' (using password: NO)"
View 1 Replies
View Related
Dec 19, 2010
I am trying to copy a directory and everything in it from one server to another.No matter what I type into SCP, it just gives me back:
usage: scp [-1246BCpqrv] [-c cipher] [-F ssh_config] [-i identity_file]
[-l limit] [-o ssh_option] [-P port] [-S program]
I tried:scp -r -P 1133 root@XX.XX.XX.XX:/home/imagesShouldn't that recursively copy /home/images from the server XX.XX.XX.XX through SSH on port 1133?Btw - I know you can do it with a tar or just a regular FTP program. The folderI am trying to copy is 40 gig, there isn't enough free space to make a tar (if the server would even do it)
View 6 Replies
View Related
May 18, 2010
I am busy learning shell scripting, and I managed to get my first few right, but now I am trying to do something that I know how to do in Windows, but not in Linux. Basically, during a file copy, I want to create a new date for each folder on a daily basis to copy backups into.so, in windows the syntax would be "xcopy %systemroot%ackupslah.blah \servernameackups\%date%"in linux I am running a "cp blah.gz /mount/blah" I want to create a folder with the date based on the current date.anyone know how to get the same right in shell script?
View 10 Replies
View Related
Jan 18, 2010
I have an access database and I would like to build a website on the slackware 12.2 server running apache 2.11.14 to let users query data from the MS Access database. I am thinking that I could just do it in jscript and make a jdbc connection and that should be good. What do you guys think.
View 2 Replies
View Related
Sep 3, 2010
How do I know the reply was from caching-nameserver, master nameserver or slave nameserver in BIND DNS.? Can I trace the nameserver that replied my dns query? Like I have a master nameserver, a slave nameserver and a caching nameserver in my network. Is it possible to know that which of these servers replied my dns query? Also can i trace back that replying server exactly?
View 3 Replies
View Related
Aug 4, 2010
I'm trying to use wget on an ubuntu 10.04 server 64bit, with 16GB RAM and 1.1 TB free disk space. It exits with the message "wget: memory exhausted". I'm trying to download 1MB of some sites. After different tries this is the command I'm using:
Code:
wget -r -x -Q1m -R "jpg,gif,jpeg,png" -U Mozilla http://www.onesite.com
(I only need the html documents, but when if I run the -A options only the first page is donwloaded, so I change to -R).
This happens with wget 1.12 version. I've tried the same command in other computers with less RAM and disk space (ubuntu 8.04 - wget 1.10.2) and it works just fine.
View 1 Replies
View Related
Oct 13, 2010
I cant update php in my RHEL Server 5.1 using yum. I am using RHEL Server 5.1 and I cant use yum to upgrade my php. Other site told me that use wget to solve this problem. How to use wget to upgrade php? This is my first time to handle linux server..
View 9 Replies
View Related
May 14, 2010
I recently turned on query logging on our name server and immediately saw repeated queries for . (dot). I've not seen this before. It looks like a really sloppy DOS. What would this return if my NS was misconfigured?
May 13 18:11:41.710 queries: info: client 91.202.63.129#56089: query: . IN NS
May 13 18:11:42.083 queries: info: client 91.202.63.129#62826: query: . IN NS
May 13 18:11:42.788 queries: info: client 91.202.63.129#13620: query: . IN NS
[code]....
View 2 Replies
View Related
Jan 12, 2011
I need to write a script that executes a wget. The difficulty being, if wget just sits there with no reply for a very long time, I don't want the script to run that long.
How can I time out the wget command in the script if it doesn't give me a reply in a minute or so?
View 3 Replies
View Related
Jan 29, 2011
I'm trying to download phpmyadmin from sourceforge => http://sourceforge.net/projects/phpm...r.bz2/download .I'm using the wget command followed by direct link from the page. All I get is some irrelevant file that has nothing common with phpMyAdmin-3.3.9-all-languages.tar.bz2.The direct link is for clients with web browsers that triger automatic download to user desktop, but I need to download the package to a server. What is the wget option to get the file from this kind of links?
View 1 Replies
View Related
Feb 18, 2011
I wish to download a webpage, which is secured by username and password, using WGET. The thing is there are many forms on that page and I dont know how to tell WGET which one should it send (by POST method) the parameters. I have solved it till this so far:
wget --post-data="predmet=xxx" --http-user="yyy" --http-password="zzz" [URL]
It gets through the authentication but it will not submit the form.
View 3 Replies
View Related
Sep 23, 2009
I'm debugging some kind of a SOAP problem. I can use wget for any domain I want, besides domains that are hosted on the server itself.
What could it be? Centos firewall & selinux are turned off.
(domains / ips removed from code)
[root@http1 ~]# wget http://www.google.com
--12:09:53-- http://www.google.com/
Resolving www.google.com... 74.125.93.103, 74.125.93.104, 74.125.93.105, ...
Connecting to www.google.com|74.125.93.103|:80... connected.
[Code].....
View 4 Replies
View Related