freelanceprogrammers.org Forum Index » Cold Fusion

"Too many open files"


View user's profile Post To page top
janewilliams20 Posted: Thu Aug 11, 2005 9:20 pm


Joined: 12 Jul 2005

Posts: 20
"Too many open files"
I`m using (or rather, the code I`ve inherited is using) CFFILE to move
a lot of files around the place. Nothing fancy, just copy file A to
location B.

Latest run, it tells me I have too many files open. OK, I`ve got up to
a few hundred copied at the time, but I was only copying, not holding
them open.

I`m running CF7 on W2K. Any guesses what I need to set to correct this?
Reply with quote
Send private message
View user's profile Post To page top
somedude8theweb Posted: Thu Aug 11, 2005 9:32 pm


Joined: 02 Apr 2005

Posts: 20
"Too many open files"
I was just reading some interesting stuff about Java Heal settings in MX 7
in the book "Advanced Macromedia Cold Fusion MX 7 Application Development".
It seems like one can tailor settings to an application specific environment
pretty nicely. I suspect you may be able to make more threads available for
file actions, allowing your application to move more files around.
If you aren`t too timid you might want to look in to it. It seems that one
can also bring a CF server to its knees in a matter of seconds, so caution
is advised!



Mark Gregory

----- Original Message -----
From: "Jane Williams" <jane.williams@...>
To: <cold_fusion@yahoogroups.com>
Sent: Thursday, August 11, 2005 9:20 AM
Subject: [cold_fusion] "Too many open files"


> I`m using (or rather, the code I`ve inherited is using) CFFILE to move
> a lot of files around the place. Nothing fancy, just copy file A to
> location B.
>
> Latest run, it tells me I have too many files open. OK, I`ve got up to
> a few hundred copied at the time, but I was only copying, not holding
> them open.
>
> I`m running CF7 on W2K. Any guesses what I need to set to correct this?
>
>
>
>
>
>
>
> Yahoo! Groups Links
>
>
>
>
>
>
>
Reply with quote
Send private message
View user's profile Post To page top
Chrystalheart Posted: Thu Aug 11, 2005 9:35 pm


Joined: 05 Apr 2005

Posts: 37
"Too many open files"
I don`t have a real answer for you Jane. Someone else might. I
have only a loose collection of thoughts which may or may not be
helpful.

I suspect that when you are copying the files, it is holding them in
cache as opened until the machine releases them after the copy is
complete. Because of the speed of the processor, the machine might
be holding too many in this open state (kind of "locked" as it were)
at a time and just not releasing them fast enough. So, perhaps you
could experiment with batching files into groups of various numbers
and then doing a placeholder kind of process in a cftry/cfcatch that
you don`t expect to work, just to put a slight distance between one
batch and another and give the computer a chance to complete its
processing of the last batch before starting the next one. I had to
do something like that (hack it as it were) on another project. I
was getting the computer tripping over itself in its haste to
complete my commands. In fact, if my memory serves me correctly, it
was the same problem... I was uploading, copying, renaming, moving,
deleting, etc., etc. And it was trying to carry out the next
command before entirely completely the prior one at times.

Good luck!

Jen

--- In cold_fusion@yahoogroups.com, "Jane Williams"
<jane.williams@u...> wrote:
> Latest run, it tells me I have too many files open. OK, I`ve got
up to a few hundred copied at the time, but I was only copying, not
holding them open.
Reply with quote
Send private message
View user's profile Post To page top
janewilliams20 Posted: Fri Aug 12, 2005 1:48 pm


Joined: 12 Jul 2005

Posts: 20
"Too many open files"
> I don`t have a real answer for you Jane. Someone else might. I
> have only a loose collection of thoughts which may or may not be
> helpful.

All thoughts are helpful,,and welcome!

> I suspect that when you are copying the files, it is holding them in
> cache as opened until the machine releases them after the copy is
> complete.

(nods) I`d guessed that, and was inwardly swearing at the coder who
didn`t tidy up this sort of thing. Nothing I can do about it, though.

> Because of the speed of the processor, the machine might
> be holding too many in this open state (kind of "locked" as it were)
> at a time and just not releasing them fast enough. So, perhaps you
> could experiment with batching files into groups of various numbers
> and then doing a placeholder kind of process in a cftry/cfcatch that
> you don`t expect to work, just to put a slight distance between one
> batch and another and give the computer a chance to complete its
> processing of the last batch before starting the next one.

Hysterical laughter from here. You may well be right. And I was putting
so much effort into speeding this process up! Yes, moving from CF5 to
CF7, and from Oracle to SQlServer, is the main object of the exercise,
but getting a process that used to crash after half a day to run in
under 10 minutes was also something I was rather proud of. And I`ll have
to slow it down again. Oh, joy. Never mind, nearly the weekend.


> In fact, if my memory serves me correctly, it
> was the same problem... I was uploading, copying, renaming, moving,
> deleting, etc., etc. And it was trying to carry out the next
> command before entirely completely the prior one at times.

It fits, doesn`t it? It fits all too well.

I`ll do that reading up about Java settings that Mark suggested, I may
be able to handle things that way (if I`m not too timid). But I think
you`ve hit the nail on the head when it comes to the underlying problem.
Reply with quote
Send private message
View user's profile Post To page top
janewilliams20 Posted: Thu Aug 25, 2005 5:47 pm


Joined: 12 Jul 2005

Posts: 20
"Too many open files"
> I was just reading some interesting stuff about Java Heal
> settings in MX 7
> in the book "Advanced Macromedia Cold Fusion MX 7 Application
> Development".
> It seems like one can tailor settings to an application
> specific environment
> pretty nicely. I suspect you may be able to make more
> threads available for
> file actions, allowing your application to move more files around.
> If you aren`t too timid you might want to look in to it. It
> seems that one
> can also bring a CF server to its knees in a matter of
> seconds, so caution is advised!


I felt timid, so I waited until we`d actually bought the book. Amazon
have now delivered, and I`m reading it, and feeling even more timid.

Daft though it sounds, I can find no reference to "Java Heal settings".
What chapter should I be looking at? Yes, I probably should (and will)
eventually read and absorb the whole book, but it`s quite tough going.
Reply with quote
Send private message
View user's profile Post To page top
somedude8theweb Posted: Fri Aug 26, 2005 12:42 am


Joined: 02 Apr 2005

Posts: 20
"Too many open files"
Er, typo! Java *Heap* settings... LOL


Mark Gregory
----- Original Message -----
From: "Williams, Jane" <jane.williams@...>
To: <cold_fusion@yahoogroups.com>
Sent: Thursday, August 25, 2005 5:47 AM
Subject: RE: [cold_fusion] "Too many open files"


> > I was just reading some interesting stuff about Java Heal
> > settings in MX 7
> > in the book "Advanced Macromedia Cold Fusion MX 7 Application
> > Development".
> > It seems like one can tailor settings to an application
> > specific environment
> > pretty nicely. I suspect you may be able to make more
> > threads available for
> > file actions, allowing your application to move more files around.
> > If you aren`t too timid you might want to look in to it. It
> > seems that one
> > can also bring a CF server to its knees in a matter of
> > seconds, so caution is advised!
>
>
> I felt timid, so I waited until we`d actually bought the book. Amazon
> have now delivered, and I`m reading it, and feeling even more timid.
>
> Daft though it sounds, I can find no reference to "Java Heal settings".
> What chapter should I be looking at? Yes, I probably should (and will)
> eventually read and absorb the whole book, but it`s quite tough going.
>
>
>
>
>
>
>
>
> Yahoo! Groups Links
>
>
>
>
>
>
>
Reply with quote
Send private message
View user's profile Post To page top
janewilliams20 Posted: Fri Aug 26, 2005 2:09 pm


Joined: 12 Jul 2005

Posts: 20
"Too many open files"
> Er, typo! Java *Heap* settings... LOL

Which isn`t in the index either, but... OMG, pp95-103, right? This is
going to require coffee. Lots of coffee. And there I was hoping for
something non-brain-intensive for a Friday. Looks like it`ll all improve
performance, though, even if it doesn`t solve this particular problem.
Reply with quote
Send private message
View user's profile Post To page top
somedude8theweb Posted: Fri Aug 26, 2005 6:42 pm


Joined: 02 Apr 2005

Posts: 20
"Too many open files"
Coffee is a good start. If there is anything uh... stronger... this might be
the time LOL!
Generations and Eden and stuff.


Mark Gregory


----- Original Message -----
From: "Williams, Jane" <jane.williams@...>
To: <cold_fusion@yahoogroups.com>
Sent: Friday, August 26, 2005 2:09 AM
Subject: RE: [cold_fusion] "Too many open files"


> > Er, typo! Java *Heap* settings... LOL
>
> Which isn`t in the index either, but... OMG, pp95-103, right? This is
> going to require coffee. Lots of coffee. And there I was hoping for
> something non-brain-intensive for a Friday. Looks like it`ll all improve
> performance, though, even if it doesn`t solve this particular problem.
>
>
>
>
>
>
>
>
> Yahoo! Groups Links
>
>
>
>
>
>
>
Reply with quote
Send private message
View user's profile Post To page top
janewilliams20 Posted: Fri Aug 26, 2005 6:48 pm


Joined: 12 Jul 2005

Posts: 20
"Too many open files"
> Coffee is a good start. If there is anything uh...
> stronger... this might be the time LOL!

Dry site :(

> Generations and Eden and stuff.

Yeah....

Though I have to say that after a few hours with that, I`m more and more
impressed with Ben Forta`s writing. Considering how complicated the
subject is, he`s made it about as comprehensible as it can be. And
useful, too.
Reply with quote
Send private message
Post new topic Reply to topic
Display posts from previous:   
 

All times are GMT
Page 1 of 1
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Freelace Website Designer - Customer web design and software building.
China Wholesale - Electronics Products
Character Studio - Tutorials and Help