From: Duncan Kennedy on
In message <1jclyrj.1ij0o6g1fo1204N%usenet(a)alienrat.co.uk>, Woody
<usenet(a)alienrat.co.uk> writes
>
>wget used to be part of osx. I dont know if it is anymore. I know I have
>downloaded it manually but really dont remember what machine that was
>for.
>

wget appears to be included Linux distros. wget -r "www.your url" will
download just about everything on, at least, an HTML (non-database)based
site. It does sometimes miss the graphics for JavaScripted roll-over
buttons that are not in use at the time of download.
--
Duncan K
Downtown Dalgety Bay
From: Ben Shimmin on
Woody <usenet(a)alienrat.co.uk>:
> James Dore <james.dore(a)new.ox.ac.uk> wrote:

[...]

>> wget has been replaced by curl.

Was this in the transition from 10.3 to 10.4? Like Woody, I can't
remember.

>> curl --help gives you the options in a 'concise' format.
>>
>> curl --manual gives you the manual. I suggest you do curl --manual >
>> curlmanual.txt and open curlmanual.txt in your favourite text editor.
>> There's a lot of stuff....
>
> That is what was so good about wget!

For basic usage, you just need one extra flag to curl(1) to make it behave
like wget(1):

$ wget foo.bar

is equivalent to

$ curl -O foo.bar

They both have pages and pages of more advanced options, some of which
will allow you to download the whole Interweb if you're not careful.

b.

--
<bas(a)bas.me.uk> <URL:http://bas.me.uk/>
`It is like Swinburne sat down on his soul's darkest night and designed an
organized sport.'
-- David Foster Wallace, _Infinite Jest_, on American football
From: Rowland McDonnell on
Woody <usenet(a)alienrat.co.uk> wrote:

> Rowland McDonnell <real-address-in-sig(a)flur.bltigibbet.invalid> wrote:
>
> > Woody <usenet(a)alienrat.co.uk> wrote:
> >
> > > Rowland McDonnell <real-address-in-sig(a)flur.bltigibbet.invalid> wrote:
[snip]

> > > > How come I can't find the file in question on local disc when I access
> > > > the Web page normally? Is it really just loaded straight into RAM?
> > >
> > > Well, if it isn't in safari (if you were using that) caches,
> >
> > Nope - is it possible to identify anything in Safari's caches? I've
> > never figured out the trick.
>
> Well, it probably is but it is quite difficult, so its never the easiest
> option.

Or any sort of option if you're me.

> > > Or maybe for small files it really does put them
> > > in memory - it would be inefficient, but I don't know how it does it.
> >
> > I've not a clue. Inefficient, when it takes 1/2 MB of RAM to store the
> > state for one thread, and the file in question is 372KB? <shrug>
> >
> > I'd've thought that much RAM usage was considered `so tiny as to be
> > irrelevant' these days.
>
> Maybe it is by some (I still am paranoid about memory use when
> programming, but it doesn't seem the norm),

<shrug> Inefficient use of RAM seems preferred by some.

> but the state coveres all
> pages, so it is easier to cache a file than reload it when you go back
> to the page.

Righto.

> > > If you did use safari you can look in the 'Activity' window, and you
> > > will see the swf file in the file list. If you double click that file it
> > > will actually download it to your normal download folder.
> >
> > No it didn't.
> >
> > It opened:
> >
> > <http://www.dailyfashiongames.com/media/0709/59298608.swf>
> >
> > and I couldn't find the swf file on disc anywhere.
>
> Oh ok. Mine downloads it to the downloads folder.

Safari 4.0.4, MacOS X 10.6.2 and it doesn't.

> > btw, I grabbed the swf file in question (using Deep Vacuum) but for some
> > reason none of my Web browsers will open it, although Safari did happily
> > open the swf as mentioned above.
> >
> > Can you explain what that's all about?
>
> Nope - its something to do with mime types, but I don't know what, and
> given that it works the dragging way,

No it doesn't.

> there is a workaround.

What is this workaround?

> > (look, I'm not at this point interested in the bloody bunny, it's the
> > technical issues of what's going on that I'm bothered about now. I
> > hope... I hope it's not the bunny. If I'm obsessed with that bunny,
> > I'm in /serious/ trouble.)
>
> hehe - I wasn't really thinking about the bunny,

I was - it's scary, that bunny, very worrying...

> it doesn't really
> matter what the swf is, the principle is the same with any of them
> (although there are additonal related issues if it is video).

Quite.

> > > Note it does download it again, rather than link to a local copy.
> >
> > What I got was a new window with the game only opened inside it. I
> > could see no copy of the swf file anywhere. I searched for the
> > identified file by name, looking at invisible and visible files and
> > *NOT* using Spotlight (may it be forever damned).
> >
> > Nuffin'
>
> Odd.

I think it's odd that you should get a file downloaded using the method
you describe - there's nothing I can see in the UI that'd imply you'd
get a download from double-clicking an item it in.

Actually, there's nothing in the UI to imply that that window is
anything other than an information display.

[snip]

> > > > Then I looked at some other Websites of the same sort, and noticed that
> > > > if I happened to see any adverts that appeared to be aimed at a specific
> > > > demographic, they were aimed at me. These bloody things seem to be
> > > > meant to attract middle aged men - huh?
> > >
> > > Thats odd!
> >
> > I think I should find out more about the sort of people who put this
> > stuff up on the Web.
>
> How would you even go about finding out about the people that put that
> stuff up?

Hmm? Oh, that. Well, I found one Website which identifies the authors
of the dressing up games they put up with links to the personal sites of
those authors.

That's some information.

I'm sure more can be found out by following that sort of thing up - and
with enough rootling around at that end, I'll end up with information
about first the people who run the non-aggregator sites in that
universe, and then something about the types who run the aggregator
sites.

Maybe not specific information about the particular individuals, but
/something/ about the deal, whatever the hell it is.

Rowland.


--
Remove the animal for email address: rowland.mcdonnell(a)dog.physics.org
Sorry - the spam got to me
http://www.mag-uk.org http://www.bmf.co.uk
UK biker? Join MAG and the BMF and stop the Eurocrats banning biking
From: Pd on
Ben Shimmin <bas(a)llamaselector.com> wrote:

> They both have pages and pages of more advanced options, some of which
> will allow you to download the whole Interweb if you're not careful.

Could you do that for me, and put it on this thumb drive?

--
Pd
From: Bruce Horrocks on
On 20/01/2010 08:22, Woody wrote:
>> Then I looked at some other Websites of the same sort, and noticed that
>> > if I happened to see any adverts that appeared to be aimed at a specific
>> > demographic, they were aimed at me. These bloody things seem to be
>> > meant to attract middle aged men - huh?

> Thats odd!

Welcome to the new world order that is Google. It knows who you are and
sends ads based on your known demographic. Someone else playing the same
game would get different ads.

Either that or they've got no other advertisers. :-)

--
Bruce Horrocks
Surrey
England
(bruce at scorecrow dot com)