General :: Using CURL To Download All Files In Certain Folder - Except 404 Error Page?
May 6, 2011
I'm using cURL in ubuntu to download some files like
While some files may be missing from this sequence but when I just use curl -O [url]
cURL will download a 404 error page for those missing ones. How can I avoid this?
View 1 Replies
ADVERTISEMENT
Jun 22, 2010
I know I have done this in the past but I apparently have some slightly off syntax. I need to download a list of files via cURL. The list of files changes dynamically and I have a server side script that runs and creates a manifest. I grab the manifest and then download the files from that. The files are formatted correctly in the manifest as I have done before but the issue is that when I grab files, only the first one is saved and the rest are written stdout. curl -O -K filemanifest.txt
Formatting of filemanifest.txt is as follows:
[URL]
[URL]
I know the filemanifest.txt format is correct as this is the same format as I have used previously without issues, I must just be calling it wrong somehow.
View 1 Replies
View Related
Jul 15, 2010
I'm trying to move font files (.ttf and .otf) from the download folder to a folder Inkscape can find them in. I tried dragging and dropping them in Dolphin but I don't have permission! So tried in the terminal:
Code:
~$ mv ~/downloads/fonts/*.*tf /usr/share/fonts
mv: cannot stat `/home/bryan/downloads/fonts/*.*tf': No such file or directory
As far as I can tell the directories exist.
View 14 Replies
View Related
Aug 9, 2011
I need to download a file from a website which has a URL formatted like:
[URL]
This redirects to a .zip file which has to be saved. There is also a need to authenticate based on username and password.
I tried to use wget, curl and lynx with no luck.
UPDATE:
wget doesnt work with redirection. It simply downloads the webpage instead of the zip file. curl gives the error "Maximum redirection exceeded > 50 " lynx also gives the same error.
View 1 Replies
View Related
Aug 10, 2011
i downloaded ubundu 11.04 off of there website and after it downloaded it it opened in winzip and i cant find the iso file do i just extract all of the files or just
View 1 Replies
View Related
Mar 15, 2010
First I go to the following URL to download the latest version of VLC Player, which I greatly prefer to Totem or any other standard Linux video/audio player: http://www.fileguru.com/Movie-Player/download. After I click on the "Download" link, a new window appears which asks me if I want to 1) Open with Archive Manager (default) or 2) Save File. There is a drop down arrow next to the first choice which only gives "Other..." as the only other choice. Well, if I choose the first option, the download appears as an .exe file in the "Downloads" window.
A window with "Download Error" in its Title Bar appears with the following message in it: "/tmp/VLC_Player_Setup-3.exe could not be opened, because the associated helper application does not exist. Change the association in your preferences." I don't even know yet how to even open up an .exe file in Linux, despite repeated research.
View 1 Replies
View Related
Jun 24, 2010
Is there any curl API to configure only the required protocol. If I have proper openssl installed, the installed curl will have all the protocols (like HTTP, HTTPS, FTP, File etc...) supported by default. Is there any way to allow or disallow only some of the protocol at the runtime. Say I need to support only HTTPS, FILE and I dont want to allow HTTP. Is there any way to do this?
View 1 Replies
View Related
Jul 26, 2010
All has been fine with my emails but today morning when i tried to log on I got an error message "You must be logged in to access this page, go to logon page" I dont understand why even when i supply my correct user name and password.
View 2 Replies
View Related
Apr 18, 2011
I am having some issues with downloading images to my website from my suppliers!
I have a text file (extracted from product their product lists) which has all of the image URLs!
I have tried to use php using the below script which was started via a cron job, however exec is blocked and my hoster has told me to use curl..... Is there something that can be written in or with curl to do the same thing?
View 4 Replies
View Related
May 25, 2011
I am trying to resume an aborted download. I have to use the curl_easy_setopt(hnd, CURLOPT_RESUME_FROM_LARGE,(curl_off_t)no. of bytes to be skipped) to set from where to start resuming download. But in run time, how would i put the no. of bytes to be skipped? Its not possible always to see how much is the size of file downloaded already. So is there any way so that prograjm will automatically know from where to start??
View 5 Replies
View Related
Sep 18, 2009
Yahoo! is shutting down Geocities and I need to download all the files in my webfolder there, is there a program that will download all the files there automatically
View 1 Replies
View Related
Jun 29, 2011
I need a link to a download page for wine. I have Ubuntu 8
View 14 Replies
View Related
Dec 21, 2010
can we use recursive download of wget to download all the wallpapers on a web page?
View 5 Replies
View Related
Jan 12, 2009
Originally Posted by van 2.0 If you are not having a problem with Samba and have nothing to offer the OP in his bid to solve the problem then your post is not relevant to the discussion. The reason I asked you to point out where SELinux has been mentioned is that those are the docs of an Enterprise OS and any relevant steps would be included.I see you are new to SELinux, but interrupting a post to point out something unrelated does not help, it just adds confusion and consternation.I think that, perhaps in your your zeal to serve as police officer of the relevance trees, you've failed to see the forest. It could be that I was not sufficiently clear in my first post here, so I'll explain it very, very slowly and carefully, so as not to cause any you any further confusion.
The original poster is unable to access his Samba shares. The original poster does not understand why and seems to think that it is configured correctly. Other posters have added suggestions about smbpasswd and testparm to check for correct syntax. Presumably, these things have not yet solved the problem, since the OP has not returned to say the problem is solved, though you linking to one of the first links that would appear in a google search for redhat and samba was no doubt wildly and extraordinarily helpful.
So, I had an idea. I recognized that, in a crazy plan to make a functional OS, the authors of Linux had allowed more than one binary to execute simultaneously. This means, that SELinux and samba can both run at the same time. Now, stay with me here - if SELinux is not configured to allow permissions for the samba user on the Samba share.... "permission denied" log errors can occur in Samba. Now, that sounds familiar for some reason. Hmmm... oh, yeah! That was what the original poster mentioned! And, I just dealt with that exact problem, caused by insufficient SELinux permissions!I knew there was a method to my madness.So, anyway, adopting your own ironically sanctimonious tone, I hope you've learned a lesson today that can improve the quality of your posting. This lesson is two-fold: (1) it's not especially good form to quibble with someone trying to help in good faith and (2) if you are going to, it pays to have something tangible to offer to go along with your condescension.No need to thank me - helping you be a better poster is its own reward, and I'm rapidly losing interest in anything you have to say in general, anyway. From what I've seen, it's not anything I couldn't find in under 10 seconds on google.
View 11 Replies
View Related
Jan 19, 2010
I am installed cUrl from http://packages.ubuntu.com/lucid/amd64/curl/download for my ubuntu 9.0 with php 5.2 ,Apache 2.0.It was installed by gkebi package installer. but when i display phpinfo() curl not found since i was attempt to use phptwitter class. what is the proble i have? When i am trying to install again package installer shows same version of curl already found, but phptwitterclass shows following error 'Method "curlQuery" of class "Twitter" reported an error: CURL library not installed.'
View 1 Replies
View Related
Jun 8, 2009
I have apache httpd server on my Fedora 10I got 2 problems:First : I copied the web page files to its Document Root <var/www/html> & Disabled the default web page. But when I visit http:/localhost ,it shows up the list of files in <var/www/html> as if a ftp server browsed in web page. So how can I set http://localhost load my default web page index.html ?Second :I want to set up a web server on Internet through my router . I applied for DDNS account & input it into router correctly . I set virtual host in server to redirect any access from port 80 to 192.168.1.2:80 in LAN . Just for in case , I also download and running the DDNS software & installed it on PC 192.168.1.2 in LAN . My DDNS provider is oray.cn . It's a Chinese server provider . I don't think there is anything wrong with oray.cn . But if you need its information just visit oray.cn (Google can translate it for you). So I want to know did I miss something to set up a web server in this kind of situation
View 2 Replies
View Related
Jun 9, 2010
i have written file transfer program using libcurl.
#include <stdio.h>
#include <curl/curl.h>
#include <curl/types.h>
[code]....
View 1 Replies
View Related
Nov 23, 2010
In Linux bash shell, for a given directory, how can I list:The create date for that directory The number of files in that directory The number of subdirectories in that directory.
View 3 Replies
View Related
Sep 10, 2009
How would i go about copying all .jpg or .JPG files from a folder and all its subfolders to my /usr/name/pictures folder? I'm guessing I'd have to use some sort of .[jJ][pP][gG] to get all the pictures from other examples i've seen, but really not sure how to use that in a recursive cp.
View 14 Replies
View Related
Mar 4, 2010
i need to copy files from a folder called output files to another folder called running but im not able to do it i always get a stat error
View 14 Replies
View Related
Feb 28, 2010
11.2 KDE 4.3.5
keep getting this error when trying to download RPM files and launching them.
KLauncher could not be reached via D-Bus. Error when calling start_service_by_desktop_path:
Not connected to D-Bus server
View 4 Replies
View Related
Nov 6, 2010
I am using curl as the following
Code:
curl "http://site.com/pages/{1,2,3,4,5}.html" > /home/myuser/allpages.html
i need to save each page in a separate page by the way i have tried this command
Code:
curl "http://site.com/pages/{1,2,3,4,5}.html" > /home/myuser/{1,2,3,4,5}.html
but it displays error
Code:
ambiguous redirect
is there any way to do that
View 5 Replies
View Related
Nov 3, 2010
I got a folder that I transfer stuff to all the time. the folder is in chmod 775 but when i upload folders and files, they are given chmod 700, but i want it chmod 775 everytime i upload something. so far i have logged in to my linux computer and did a chmod -R 775 to the folder every time i uploaded something to it. is there a function somewhere to make it 775 everytime i upload or can i have something run a script, so i don't have to go in and write it everytime i upload something?
View 2 Replies
View Related
Nov 9, 2010
I use slackware current, and curl and wget give the following errors:
Code:
repo@cannabis ~]$ wget -r http://users.telenet.be/reggersjans
--2010-11-09 13:48:14-- http://users.telenet.be/reggersjans
Resolving users.telenet.be (users.telenet.be)... ::ffff:74.117.221.11, 74.117.221.11
Connecting to users.telenet.be (users.telenet.be)|::ffff:74.117.221.11|:80... connected.
HTTP request sent, awaiting response... 400 Bad Request
[Code]...
View 7 Replies
View Related
Jan 26, 2011
I have a strange problem with using curl function in php on slackware machines. So far I tested this on 2 PCs. I din't test it on any other distributions, so I don't know if it's only slackware problem.
Problem is that I can't use php curl in normal way. It can be tested wit simple code:
Code:
$ch = curl_init("url");
$content = curl_exec($ch);
if (curl_error($ch)) {
echo(curl_error($ch) . "<br>");
}
echo($content);
When I'm opening this php script in browser I'm getting error message:
Code:
Couldn't resolve host 'google.lv'
but I can use curl command in terminal, also it works when I run this php script in terminal like:
Code:
php ./curl_test.php
So problem is not in curl or php itself, but in apache, because this happens only when this script is running in apache.
Searching google a lot, I got to conclusion that apache can't read /etc/resolve.conf file during startup. Strange thing is that it happens only when httpd starts during system startup, but if I'm stopping httpd and starting it again manually, it works as it should until I'll reboot my PC. Restarting httpd also do not work, I need to do start -> stop.
I think that apache reads /etc/resolve.conf only when it starting up and as I have DHCP, maybe network is still not ready at the moment of httpd startup.
I didn't try to configure php as php-cgi instead of apache module, I think then it would work normally because each php script would be separate process and it would read dns information each time, so the same like starting php script in terminal with command:
Code:
php ./curl_test.php
I think there are some ways to workaround it, e.g. delay somehow start of httpd during system startup, or something like that, but I want to find reason of this problem and make it work without any workaround.
View 1 Replies
View Related
Aug 24, 2010
I have a voip program downloaded. It is in tar.gz format. It is in my home/download folder. How to install that?
View 6 Replies
View Related
Aug 29, 2010
curl -L http://URL/file[1-2].txt -o $(date +%m-%d-%y) newfilename{1,2}.txt
Basically, this command goes to URL, downloads file1.txt and file2.txt, however it saves BOTH files as newfilename1.txt. I would like the script to name the second download (file2.txt) newfilename2.txt. So, before you say to use the -O switch in Curl, please understand that I wish to rename the files so that they are not what they were on the server (names are too long). So file1.txt becomes newfilename1.txt, file2.txt becomes newfilename2.txt. Is this possible? The command I listed works only until the newfilename{1,2}.txt, it always saves as newfilename1.txt
View 3 Replies
View Related
Mar 19, 2011
Failed to fetch [URL] 404 Not Found Some index files failed to download, they have been ignored, or old ones used instead. I have been getting this for a while now complete with a red triangle with an ! in it on the panel.
View 1 Replies
View Related
Aug 2, 2010
I'm trying to grab "repo" using curl and put it into /usr/local/bin/ but I can't seem to figure out why I'm getting a permission error:
Code:
$ sudo curl https://android.git.kernel.org/repo > /usr/local/bin/repo
bash: /usr/local/bin/repo: Permission denied
[code]....
View 1 Replies
View Related
Feb 17, 2010
I have two suse linux server. Recently we got the license key. In one server i could able to register successfully. Another server is throwing an error.i am using yast-software- Novel customer center configuration. After selecting configure now, i am getting error has follows Execute curl command failed with 7 curl: (7) could't connect to host.
View 3 Replies
View Related