Programming :: Python Error - List Index Out Of Range (Web Scrapper)
Feb 18, 2011
Having a bit of an issue with Python while trying to write a script to download every rar file on a webpage. The script successfully downloads any link that doesn't contain any spaces, etc. But when it hits a url like: [URL] (Classical Spelling).rar. It fails...I'm sure this is something simple, but I'm so new to python I'm not sure what to do!
Code:
import urllib2
import os
os.system("curl [URL] -i rar|cut -d '"' -f 2 > temp.out ")
infile =open('temp.out', 'r')
for url in infile:
print url
#url = "[URL]"
#url = target
file_name = url.split('/')[-1]
u = urllib2.urlopen(url)
f = open(file_name, 'w')
meta = u.info()
file_size = int(meta.getheaders("Content-Length")[0])
print "Downloading: %s Bytes: %s" % (file_name, file_size)
file_size_dl = 0
block_sz = 8192
while True:
buffer = u.read(block_sz)
if not buffer:
break
file_size_dl += block_sz
f.write(buffer)
status = r"%10d [%3.2f%%]" % (file_size_dl, file_size_dl * 100. / file_size)
status = status + chr(8)*(len(status)+1)
print status,
f.close()
View 7 Replies
ADVERTISEMENT
Jun 6, 2011
I'm building an install CD from CentOS 5.6 and some custom packages using anaconda-11.1.2.224-1.el5 from the CentOS 5.6 repo.
splittree fails with
Traceback (most recent call last):
File "./splittree.py", line 481, in ?
logfile = timber.main()
File "./splittree.py", line 398, in main
[Code].....
View 1 Replies
View Related
Apr 5, 2011
So I have been trying for 8 hours to try to get the index of an element from a list in a Makefile. The problem is that after I get the index using all the methods I have tried, the index cant be used in the "word" function:
for instance:
$(OUTPUT2) : INDEX = $(shell echo $(OUTPUT2) | sed -r -e "s/[ ]+/
/g" | grep -n $@ | sed 's/^([0-9]*):.*/1/')
will create a variable INDEX defined specifically for each member of OUTPUT2, so that each output knows its index. Unfortunately, when I pass this $(INDEX) into word, it doesn't work:
$(OUTPUT2) : $(word $(INDEX), $(INPUT1)) $(word $(INDEX), $(INPUT2))
echo $(INAME) $(TMPBASE) $@
and I get the error:
Makefile:16: *** non-numeric first argument to `word' function: 'num'. Stop.
I feel like if I could just convert a string to a Makefile acceptable number this would just work....
View 6 Replies
View Related
May 10, 2011
I have a list of list and I'd like to sort the list according to the last value of each row.
Let's say we have the list
L1 = [ [1,2] , [4,6] , [78,-3] ]
I wish to get
L2 = [ [78,-3] , [1,2] , [4,6] ]
Is there a simple way to do that in python?
View 4 Replies
View Related
May 11, 2009
so far I have this
list = open('list.txt')
for x in list:
list.read(x)
View 3 Replies
View Related
Jul 19, 2010
I am trying to get a list of running processes using audio (using gstreamer), just like in gnome-volume-control, under applications, but have so far been unsuccessful in finding anything in either the gtk or gstreamer library, anyone out there who can point me in the right direction?
View 1 Replies
View Related
Jul 9, 2011
how to dynamically create a list within a dictionary using Python.
Code:
dates = defaultdict(int)
array = []
...
dates[m.group(3)] = array.append(date)
dates[m.group(3)] = [array.append(date)]
dates[m.group(3)].append(date)
None of the above works and I've tried everything I can think of.
View 3 Replies
View Related
Oct 14, 2013
I'm trying to search for several strings, which I have in a .txt file line by line, on another file.
So the idea is, take input.txt and search for each line in that file in another file, let's call it rules.txt.
So far, I've been able to do this, to search for individual strings:
Code: Select allimport re
shakes = open("output.csv", "r")
for line in shakes:
if re.match("STRING", line):
print line,
How can I change this to input the strings to be searched from another file?
So far I haven't been able to.
View 3 Replies
View Related
Jan 29, 2014
I going through the Python course on Codeacademy. I have some trouble understanding what I'm doing wrong. This is my code below:
Code: Select alldef count(sequence, item):
total = 0
for x in sequence:
return x
if x in sequence:
total += 1
return total
print count([1,2,1,1], 1 )
The code gives me an error: "Oops, try again. Your function fails on count([1],7). It returns 1 when it should return 0."
It should be outputting 3 because 1 occurs 3 times in the list.
View 7 Replies
View Related
Oct 5, 2015
I have up until now been able to use the add-apt-repository command without issue but right now it keeps returning an IndexError.
The error is below:
Code:
Select allx@y:~$ sudo add-apt-repository ppa:/kilian/f.lux
Traceback (most recent call last):
File "/usr/bin/add-apt-repository", line 122, in <module>
shortcut = shortcut_handler(line)
[Code] ....
IndexError: string index out of range
I have tried using the command with an empty ppa (just sudo add-apt-repository ppa:) but that comes with the same error. Googling the issue only brought up some bugreports of a month back, and I've used the command with success a few days ago.
View 4 Replies
View Related
Apr 4, 2011
create a tar file from a list? My script returns the error: AttributeError: 'list' object has no attribute 'startswith' I want to create a compressed tar file containing the directory /usr/lib and the files in the list assigned to variable b.
code:
import tarfile
tar = tarfile.open("backup.gz", "w:gz")
[code]....
View 3 Replies
View Related
Apr 19, 2011
When I start Gnome-Schedule, it opens and closed right away. Here's the output:
[Code]....
IndexError: string index out of range Also before this happened, I tried to add this command to G.S. but nothing happened when I clicked "Add":
[Code]...
View 1 Replies
View Related
Apr 11, 2011
I want to build a bash script, which can ping a range IP adresses which will be filled in by the admin. If there is no IP-adress filled in, then the script must ping the subnet where the system is logged on. So if my ip is 192.168.1.6, then the script must ping from 192.168.1.1 till 192.168.1.255 Or else, if there is given a beginning and ending ip it must ping that!
The first part of the bash script is to ping a given range (see below). But there is one problem, how can I tell the script to ping from $begin till $end, [..] is of course wrong! But what must be filled in there???
echo "Enter beginning IP-adres:"
read begin
echo "Enter ending IP-adres:"
read end
ping -c 1 $begin [..] $end
The second part is to find my own ip and ping the whole range.. How to do that? I only can find my own IP, but I cant ping the whole range,, how to do that?
#!/bin/bash
ifconfig | grep 'inet addr:' | grep -v '127.0.0.1' |
cut -d: -f2 | awk '{ print $1 }'
View 11 Replies
View Related
Nov 19, 2008
I'm having a bit of trouble with a regular expression I'm trying to write and I'm not sure if it's something Tcl specific or my lack of regexp understanding.
[Code]...
I get a number of strings passed to a proc in the format 3|x where x is a number, either 0 or within the range 5-12. My understanding is that that regexp will match the literal '3' followed by a '|', the escapes the special meaning of |, and then 0 or, because of |, a number within the range 5-12. However I'm getting the error 'couldn't compile regular expression pattern: invalid character range'.
View 3 Replies
View Related
Jul 21, 2011
I am building a python script which works same as SMTP protocol. I have build separate functions in that for each command of SMTP, and after this i have integrated all those functions in a new function named as send_mail(so that i don't have to execute every function separately for every command). Now, when i execute the script for the first time it runs successfully, but for the second time it gives the error of "BROKEN PIPE". I really can't make out how the socket is getting closed.
View 5 Replies
View Related
Sep 23, 2015
Just installed Debian 8 last night and trying to run one a few of my scripts that use easygui (a front-end for python-tk basically) and I keep getting alloc: invalid block any time a file or folder selection dialog is presented. I'm able to select a file/folder with no issues, but once the dialog closes I get a variation of what appears to be a memory error followed by alloc: invalid block.
Here's one of my scripts that does it. This one pops up a file selection dialog pretty early on to ask for a file to check, and as soon as I select any file the dialog closes and that error appears in the terminal. It happens whether I run it with Python 2 or Python 3. You will need to install python3-easygui for this script to run properly if you want to check for yourself what happens. This is a first time encountering this error for me.
View 1 Replies
View Related
Apr 16, 2010
I need to write program (preffer Python) to change range for users. Does anyone know some library which can help me to do that? Maybe someone has written program like that?
View 5 Replies
View Related
Mar 22, 2009
I want to be able to do
sudo ./program.py
instead of always having to do
sudo python program.py
What do I need to change?
View 5 Replies
View Related
Nov 30, 2009
I've already used line split stuff to transform my data into something like this in a text file:
Code:
['1', '1', '3', '20.7505207']
['2', '1', '3', '23.0488319']
['3', '1', '3', '-1.5768747']
['4', '1', '3', '-26.4772491']
[code]....
How can I get this on a python program so I can manipulate it as an array?
View 3 Replies
View Related
Sep 23, 2010
I wrote a program to create a link list
Code:
#include <stdio.h>
#include <stdlib.h>
struct node {
[Code].....
View 4 Replies
View Related
Mar 4, 2010
I have a function definition in a Python 2.x script which take a tuple as one of its arguments, but 2to3 has no answers nor any of my searching on how to represent the same in Python 3.x
Code:
def blah(self, (string1, string2))
View 4 Replies
View Related
Feb 2, 2010
How would I list 4 users ID numbered 10, 11, 12 and 13 from my users list and output them to a file busers where their names are numbered by ascending order? How would I accomplish that on a one line command?
View 4 Replies
View Related
Feb 10, 2009
I am trying to get this script to work. The purpose is to download a list of modules from the slax.org the list consist of a list of module numbers. What I am trying to do is Download the file or the file name corresponding to the number in the list.the list is comma delimited. this is what I have done so far and I am a stand still.
#!/bin/sh
# Wget script to retrieve modules from slax.org modules
#
# ----Begin of user defined values -----
# Path to wget
[code].....
View 7 Replies
View Related
Apr 2, 2010
I am trying to port c & c++ open source code onto embedded target(MIPS).It compiles fine on x86/RH4. When I try embedded platform specific tool chain as follows, I get following error:
I tried different combinations. It did not help. My idea is to port an open source code that works fine on X86/Linux to an embedded target based on MIPS.
View 4 Replies
View Related
May 3, 2010
I am having a little trouble with a Bash shell script that I am working on. It is intended to read the information out of a gedcom genealogy file and determine who has lived in a particular area and output a report based upon who lived in a given area (like the different sections of a bygdebok for example). I am having a number of issues.
1) I can't seem to figure out how to get a variable to work as the index of an array. For example, I am trying to use the variable $individual to count which individual is being read in from the .ged file, and once that is figured out, next I will read in the individual's name, so I would like to create an array of names using the variable
Code:
$individual
as the index of the array. However, if I try the code
Code:
name[$individual]=$lineoftext;
[Code]....
I included only the last few lines of output as to not take up too much space because the output goes on forever, but you get the point from the example. This output has nothing to do with what the final output of the program is intended to be like. It is merely a test to prove that the 2 variables in question are getting their date loaded in properly.
View 14 Replies
View Related
May 4, 2011
don't know much, but when I tried to update I get this error:
E: Type 'sudo' is not known on line 52 in source list /etc/apt/sources.list E: The list of sources could not be read.
View 2 Replies
View Related
Sep 25, 2010
I need a script that can do this: A script that searches all directories and subdirectories for .html files When a .html file is found it creates a index.html file in that folder. It then edits the index.html file and inserts links to all of the .html files that are in that folder into the body. If no .html files are found, it searches for folders. It then creates a index.html file with links to all of the folders.
View 4 Replies
View Related
Feb 9, 2011
I want that I click with the mouse on the video, it paused.I notice that there is "BaconVideoWidget" which I guess is the video rendering widget but it don't have signal named "clicked":
Code:
vd = totem_object.get_video_widget()
vd.connect("clicked", vd.hide)
[code]....
View 3 Replies
View Related
Nov 29, 2009
i use fedora 12 i can't use yum any more , when i try i find error message it was working correctly and i donn't remember what i did
[root@PC ~]# yum list installed| grep -i nmap
rpmdb: Thread/process 2405/3078244032 failed: Thread died in Berkeley DB library
error: db4 error(-30974) from dbenv->failchk: DB_RUNRECOVERY: Fatal error, run database recovery
[code]....
View 4 Replies
View Related
Sep 2, 2010
I get the following message when I try to add or remove programs. This includes when I try to use the Update Manager: Software index is broken. It is impossible to install or remove any software. Please use the package manager "Synaptic" or run "sudo apt-get install -f" in a terminal to fix this issue at first. When I follow this advice, I get the following message:
tom@Compaq:~$ sudo apt-get install -f
E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)
E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?
If anyone can offer suggestions about this problem, Although I've been using Ubuntu for a while, I'm not very confident with the command line (unless I am copy and pasting commands!)
View 9 Replies
View Related