Fedora :: Program To Recursively Check A Web Site For Broken Links?
Sep 21, 2010Is there a program, or command, that will allow me to recursively check a web site for broken links?
View 2 RepliesIs there a program, or command, that will allow me to recursively check a web site for broken links?
View 2 RepliesI have a web app that has a bunch of symbolic links in subdirectories throughout it.I need to move the app to another directory structure, and I need to update all the symlinks to point to the new path.The problem is that there's a lot of these scattered throughout various directories.How can I recursively search from the root and recreate all symlinks pointing to /dev/ with /qa/?
View 3 Replies View RelatedI had F11 which was working OK'ish on my laptop and decided to upgrade to F12 when it was available. This was not too successful and I started getting problem with updates to the extent that I could not install any as I got errors which stopped the updates. Bit the bullet and backed up all the data then wiped the disk and started from a clean downloaded DVD of the full F12. Still getting problems running the updates (output below) and trying to install/run VirtualBox is also failing (also below). The build and source mentioned show as broken links, where do I go next?
Update errors -
Error Type: <class 'yum.Errors.RepoError'>
Error Value: Error getting repository data for installed, repository not found
File : /usr/share/PackageKit/helpers/yum/yumBackend.py, line 3125, in <module> main()
File : /usr/share/PackageKit/helpers/yum/yumBackend.py, line 3122, in main
backend.dispatcher(sys.argv[1:])
File : /usr/lib/python2.6/site-packages/packagekit/backend.py, line 710, in dispatcher
self.dispatch_command(args[0], args[1:])
File : /usr/lib/python2.6/site-packages/packagekit/backend.py, line 657, in dispatch_command
self.update_packages(only_trusted, package_ids)
File : /usr/share/PackageKit/helpers/yum/yumBackend.py, line 1948, in update_packages
signed = self._is_package_repo_signed(pkg)
File : /usr/share/PackageKit/helpers/yum/yumBackend.py, line 1437, in _is_package_repo_signed
repo = self.yumbase.repos.getRepo(pkg.repoid)
File : /usr/lib/python2.6/site-packages/yum/repos.py, line 121, in getRepo
'Error getting repository data for $s, repository not found' $ (repoid)
VirtualBox install log error
Error! Your kernel source for kernel 2.6.32.9-70.fc12.i686.PAE cannot be found at
/lib/modules/2.6.32.9-70.fc12.i686.PAE/build or /lib/modules/2.6.32.9-70.fc12.i686.PAE/source.
How do you instruct wget to recursively crawl a website and only download certain types of images? I tried using this to crawl a site and only download Jpeg images:
wget --no-parent --wait=10 --limit-rate=100K --recursive --accept=jpg,jpeg --no-directories http://somedomain/images/page1.html
However, even though page1.html contains hundreds of links to subpages, which themselves have direct links to images, wget reports things like "Removing subpage13.html since it should be rejected", and never downloads any images, since none are directly linked to from the starting page.I'm assuming this is because my --accept is being used to both direct the crawl and filter content to download, whereas I want it used only to direct the download of content. How can I make wget crawl all links, but only download files with certain extensions like *.jpeg?
EDIT: Also, some pages are dynamic, and are generated via a CGI script (e.g. img.cgi?fo9s0f989wefw90e). Even if I add cgi to my accept list (e.g. --accept=jpg,jpeg,html,cgi) these still always get rejected. Is there a way around this?
I just got an email from google saying my site contained malware. It has a line in it: "<script src='http://whitepix.info/3'></script>". I've noticed its recursively in all my .html and .txt files in my website. Can I make a linux script to run that will go through all my .html and txt files recursively and delete that line from them? I don't know how it got in all of them.
View 6 Replies View Relatedwhere can i find information about where i can volunteer help on the radeonhd project ? ive cgecked the radeonhd web site and find no links for contact
View 1 Replies View RelatedI am trying to check spelling in a text document, but gedit (v. 2.28.0) reports every word as incorrect. When I check the "autospell" option, it highlights the entire document. When I try to set the language, the language list is empty. I do have aspell and aspell-en installed, but gedit seems to ignore them. aspell works fine from the command line. The SpellChecker plugin is installed. Anyone has an idea what might be missing? Some env variable is not set correctly? Any other leads? (I am on Fedora 12).
I wouldn't be asking, but I'm tuning this up for someone who isn't command-line-knowledgeable.
how the bash script should look to copy huge directory with multiple sub-folders to a new place place while checking load and stopping for several seconds if load reached lets say 3 or 4 ? I only know the simple command cp -r /dir/allfiles /dir/newplace However would like to copy over 30 000 files which will cause me a high load.
View 1 Replies View RelatedI will have to code this. However I am lacking of time since I have too much to do. make a short code bash/dash to prompt the country with Zenity, then, get the PLS or m3u url and prompt with another zenity which radio to play. http://www.listenlive.eu/index.html
My code to get url's radio country.htm is:
Code:
Apparently I have some broken links in /usr/bin/hich causes nautilus to crash and restart. If I navigate to /usr/bin/ using gnome-commander I can see the files, as well as using terminal
View 3 Replies View RelatedI reinstalled Linux, in a new Partition, just formatted. Now, when I try to install, or copy, into my /usr/local/"whatever" folders I just see broken links of the files (the little x in the right top of the file, I presume is a broken link).But when I see the file in nautilus, the files seems to be good. But the programs doesn't works. The programs I've been installing are NukeX and UV Layout. The weird thing is that the very first time I installed Linux everything worked smoothly. Since I formatted the partition I've only unistalled Noveau and installed the Nvidia latest drivers of my GPU.
View 2 Replies View RelatedI could not get my HP printer to work. So in a not so brilliant move, I have uninstalled hplip and hptool and reinstalled it.Even tough the command line message is telling that it is installed, the HPtoolbox would not run (both from the command line or the menu).Did some digging and found that all the HP related files in /usr/bin were all labelled <broken link>.So, I deleted all these.Before I tried to reinstall again, should I worry about all the leftover hplip files?
View 1 Replies View RelatedI upgraded directly from 10.04 (Lucid), and now have TWO problems. I thought I was upgrading to 10.10. Surprise! I now have 11.04, and the following Web site is broken:
http://kdhx.fm/archives/archive_gen....icfromthehills
There are two "Play buttons just above two dates. Neither button is now visible, and neither works. So I have two problems:
(1) How do I get that to play? What is the format/requirement?
(2) How the heck did I get directly to Natty Narwhal, and how do I get back?
My recent borked upgrade to -current inspired me to try to come up with a way to sanity-check the lib and bin dirs for broken library symlinks (possibly indicating missing libs) and for binaries and libraries that belong to no installed package, as well as missing dependencies.
This script is the result.
I've checked the script results manually, and it appears to be accurate, so I figured I'd post it here for a second opinion, and/or because others may find it useful too. I'm not aware of another popular method of doing this on Slackware, so here it is:
Code:
I want to check my php script which contains php mail() function.But all the free hosting sites blocked the php mail() function because of spammers.I spend 5 hours for signing up in various hosting sites to check my script but none works.Is there a way to check whether a site allows php mail() function
View 1 Replies View RelatedI use Firefox 3.5.9 and Ubuntu 9.10.
There is a suspicious amount of data (more than a megabyte) being uploaded from my computer whenever I log onto a commercial web site on which I advertise rental properties.
Is there any way I can see the data being uploaded - I am pretty familiar with the Unix/Linux system and commands.
I need a software to download links from a site (many links). I want a software that only ask me once to where save links and only open one window.
I used wget but I can't control it when needed for example if it can't download a link.
cURL and kget and 'down them all' have problems I said before.
I use Firefox an FlashGot so I can select 'flashgot all' it sends all links to the download manager I have selected before.
The spell checker on my installation of open office 3.0 writer in Ubuntu 9.04 amd64 doesn't work. I have been through the options route, following the buit in help and set to english. That didn't work. I have been online, using the link from inside the program, and put a new version of the dictionary on my desktop and added it and that didn't work either. I have also reinstalled the whole thing via synaptic and that didn't work either. Using abword in the meantime but would rather have open office working again. In all three cases the gui seems to think all is well but when I check a page of garbage words am told that the check is complete. I can not use the enable tab as writer seems to think that the dictionary is present and enabled anyway. Does anyone know what may be wrong in my setup or have a fix for this?
View 2 Replies View RelatedSometime earlier this week, after an Update Manager update, spell check in Evolution broke.
It started underlining all words, even simple ones like "the".
I Googled around and found this article: [URL]
First, I did as recommended: 'Then go to "Edit | Preferences | Composer Preferences | Spell Checking", and enable the available languages." I found a list of languages and found that the USA version of English was enabled.
It then says, "You can also check gnome-enabled dictionaries by using gconf-editor. The GConf key /GNOME/Spell/language should contain a space-separated list of the languages you have enabled (i.e. en-US es for US english and Spanish)."
No such key found in GConf.
I followed the next instruction ("you could also try the hard way: Shut Evolution down by closing Evolution and then using the command evolution --force-shutdown. After that, run gconftool-2 --unset /GNOME/Spell/mtime.") which I did, gfcontool-2 --unset /GNOME/Spell/mtime returned with no error or comment.
But now, spell check isn't working at all, even misspelled words are not flagged, and "Edit | Preferences | Composer Preferences | Spell Checking" shows no languages to select from.
Finally, the instructions say, "If all this does not help, remove the file $HOME/.gconf/GNOME/Spell/%gconf.xml so all your spellchecking settings get deleted. The file gets recreated and according to some users on the Evolution mailing list, spellchecking should work again"
I found no "Spell" directory under "$HOME/.gconf"
I'm not a terrible speller, but do miss the okashunal werd, so having the spell checker working again would be useful.
I have a GeForce 8600M GS card in a Dell Vostro 1710, which has appeared to be playing up lately, but I'm unsure whether it's the hardware itself or have I not properly set things up.
I have Ubuntu 10.04 installed with compiz, and 'rotate cube' enabled. The 'deformation' is set to cylinder. I recently tried using rss-glx (really slick screensaver) when the slow-down and screen freezes happened.
The symptoms:
Odd behaviour begins after attempting to log in after the screensaver has blanked the screen, i.e. screensaver ran for a while then the screen blanked. When logged back in, a 'cylinder' rotate freezes and the screen does not refresh. Clicking around the screen refreshes it somewhat. Switching between screens becomes next to impossible and a restart is required.
In general rotating the cube is OK, rotating the cylinder seems a task on the video card and rotating the sphere is horribly slow.
Things done so far:
Each time I log in, I need to open the NVidia settings and change the powermizer to 'prefer maximum performance'. On next reboot I will try this in xorg.conf code...
My questions are:
- How can I verify the card is working correctly, enough to be able to decide whether it's hardware or software at fault?
- If the hardware is proven to be OK, what am I then leaving out?
I should know how to do this, but. Using Ubuntu Jaunty. I have tried using dpkg --purge no joy
Code:
At my Uni, we use a web-based login for our internet connections. Its based off of Cisco, and every Wednesday night every computer on campus must re-enter their credentials to use the network.
Normally on my several computers I simply pull up the Terminal, point links to google.com using
Code:
And enter my credentials when Cisco redirects to the login page.
Literally, the process is
Code:
Then ENTER to accept the redirect, down arrow to skip over the logo image, USERNAME, ENTER, PASSWORD, ENTER, ENTER.
Naturally, this is EXTREMELY time consuming, as I have about 5 computers located around campus and must physically walk to the machines and login every single week.
My question is, How would I formulate a program that does the following;
1) checks for connectivity (i.e. is able to reach/resolve to the greater part of the internet) and
2) automatically fills in the credentials on the links login page?
I have a personal wiki of notes, with now thousands of links in markdown format:
[link text](http://example.com)
but now that fckeditor is available for mediawiki (very beta), it has become much better to just stick with wikitext format. There are only a few conversions to do: tables, links, and bulleted lists. The lists are a fairly simple regex and fckeditor magically reformats the tables, so all I'm left with is the links. But I'm not a regex master. How do I reformat code...
Since the upgrade I have not been able to get keyTouch to work. I have the KDE 4.3 desktop. I have xbindkeys and GTK2 installed. I have installed the KMix plugin. I can start keyTouch in system services, but it stops immediately. If I try to refresh I get /etc/init.d/keytouch-init status returned 1 (program is dead and /var/run pid file exists): I have no idea what that means.
View 6 Replies View RelatedI want to check what program is using some ports. I have
Code:
netstat -a | grep localhost
tcp 0 0 localhost:58935 localhost:www ESTABLISHED
tcp6 355 0 localhost:www localhost:58935 ESTABLISHED
udp 0 0 localhost:53888 localhost:53888 ESTABLISHED
I try ps aux | grep 53888. What other command can I use?
my server get hanged when ever their is loading problem. i wanna a program to get cpu load and also when load get high from a specified load value it should restart service. is their is any programm or how to write that programm..
View 12 Replies View RelatedIm trying to run a program but my system won't let me.i used to be able to run executable files without a problem but i can't anymore when i double click the file i get "there is no application installed for executable files" i am unable to check "allow executing file as program" in file properties there is a script file which runs the program but all i get from the terminal is "permission denied"
View 14 Replies View RelatedI'm not talking about like:
apt-get check
I mean it's like, and I thought it was this:
valgrind <application>
Needs:
x
y
z
Does anyone know what I'm talking about? A lot of programs I'm getting segmentation faults like Rhythmbox, a few games, etc. so I dunno.
EDIT: gdb kind of works, but doesn't show me what another program would..
My internet connection is really bad,so I need some kind of program to make a text file or something saying when internet connection is gone and time and date,also if possible to say why is it gone,is it my problem or is it my internet providers problem.
View 1 Replies View RelatedI am writing a simple C program which has to find whether the system is connected to network/internet or not..
View 10 Replies View Related