This is a live mirror of the Perl 5 development currently hosted at https://github.com/perl/perl5
Dedodgify.
[perl5.git] / pod / perlfaq3.pod
CommitLineData
68dc0745 1=head1 NAME
2
bfeeaf1b 3perlfaq3 - Programming Tools ($Revision: 1.18 $, $Date: 2002/04/09 17:11:16 $)
68dc0745 4
5=head1 DESCRIPTION
6
7This section of the FAQ answers questions related to programmer tools
8and programming support.
9
10=head2 How do I do (anything)?
11
12Have you looked at CPAN (see L<perlfaq2>)? The chances are that
13someone has already written a module that can solve your problem.
3958b146 14Have you read the appropriate manpages? Here's a brief index:
68dc0745 15
5a964f20
TC
16 Basics perldata, perlvar, perlsyn, perlop, perlsub
17 Execution perlrun, perldebug
18 Functions perlfunc
68dc0745 19 Objects perlref, perlmod, perlobj, perltie
20 Data Structures perlref, perllol, perldsc
f102b883 21 Modules perlmod, perlmodlib, perlsub
d92eb7b0 22 Regexes perlre, perlfunc, perlop, perllocale
68dc0745 23 Moving to perl5 perltrap, perl
24 Linking w/C perlxstut, perlxs, perlcall, perlguts, perlembed
06a5f41f
JH
25 Various http://www.cpan.org/misc/olddoc/FMTEYEWTK.tgz
26 (not a man-page but still useful, a collection
27 of various essays on Perl techniques)
68dc0745 28
3958b146 29A crude table of contents for the Perl manpage set is found in L<perltoc>.
68dc0745 30
31=head2 How can I use Perl interactively?
32
33The typical approach uses the Perl debugger, described in the
3958b146 34perldebug(1) manpage, on an ``empty'' program, like this:
68dc0745 35
36 perl -de 42
37
38Now just type in any legal Perl code, and it will be immediately
39evaluated. You can also examine the symbol table, get stack
40backtraces, check variable values, set breakpoints, and other
92c2ed05 41operations typically found in symbolic debuggers.
68dc0745 42
43=head2 Is there a Perl shell?
44
55e174a4
JH
45In general, not yet. There is psh available at
46
47 http://www.focusresearch.com/gregor/psh
48
49Which includes the following description:
50
51 The Perl Shell is a shell that combines the interactive nature
52 of a Unix shell with the power of Perl. The goal is to eventually
53 have a full featured shell that behaves as expected for normal
54 shell activity. But, the Perl Shell will use Perl syntax and
da75cd15 55 functionality for control-flow statements and other things.
55e174a4
JH
56
57The Shell.pm module (distributed with Perl) makes Perl try commands
58which aren't part of the Perl language as shell commands. perlsh
59from the source distribution is simplistic and uninteresting, but
60may still be what you want.
68dc0745 61
62=head2 How do I debug my Perl programs?
63
9f1b1f2d 64Have you tried C<use warnings> or used C<-w>? They enable warnings
a6dd486b 65to detect dubious practices.
68dc0745 66
92c2ed05
GS
67Have you tried C<use strict>? It prevents you from using symbolic
68references, makes you predeclare any subroutines that you call as bare
69words, and (probably most importantly) forces you to predeclare your
a6dd486b 70variables with C<my>, C<our>, or C<use vars>.
68dc0745 71
a6dd486b
JB
72Did you check the return values of each and every system call? The operating
73system (and thus Perl) tells you whether they worked, and if not
92c2ed05 74why.
68dc0745 75
92c2ed05
GS
76 open(FH, "> /etc/cantwrite")
77 or die "Couldn't write to /etc/cantwrite: $!\n";
68dc0745 78
92c2ed05 79Did you read L<perltrap>? It's full of gotchas for old and new Perl
a6dd486b 80programmers and even has sections for those of you who are upgrading
92c2ed05
GS
81from languages like I<awk> and I<C>.
82
83Have you tried the Perl debugger, described in L<perldebug>? You can
84step through your program and see what it's doing and thus work out
85why what it's doing isn't what it should be doing.
68dc0745 86
87=head2 How do I profile my Perl programs?
88
e083a89c 89You should get the Devel::DProf module from the standard distribution
733271b5
PK
90(or separately on CPAN) and also use Benchmark.pm from the standard
91distribution. The Benchmark module lets you time specific portions of
92your code, while Devel::DProf gives detailed breakdowns of where your
e083a89c 93code spends its time.
68dc0745 94
92c2ed05
GS
95Here's a sample use of Benchmark:
96
97 use Benchmark;
98
99 @junk = `cat /etc/motd`;
100 $count = 10_000;
101
102 timethese($count, {
103 'map' => sub { my @a = @junk;
104 map { s/a/b/ } @a;
105 return @a
106 },
107 'for' => sub { my @a = @junk;
108 local $_;
109 for (@a) { s/a/b/ };
110 return @a },
111 });
112
113This is what it prints (on one machine--your results will be dependent
114on your hardware, operating system, and the load on your machine):
115
116 Benchmark: timing 10000 iterations of for, map...
117 for: 4 secs ( 3.97 usr 0.01 sys = 3.98 cpu)
118 map: 6 secs ( 4.97 usr 0.00 sys = 4.97 cpu)
119
65acb1b1 120Be aware that a good benchmark is very hard to write. It only tests the
a6dd486b 121data you give it and proves little about the differing complexities
65acb1b1
TC
122of contrasting algorithms.
123
68dc0745 124=head2 How do I cross-reference my Perl programs?
125
83ded9ee
JH
126The B::Xref module can be used to generate cross-reference reports
127for Perl programs.
68dc0745 128
c8db1d39 129 perl -MO=Xref[,OPTIONS] scriptname.plx
68dc0745 130
131=head2 Is there a pretty-printer (formatter) for Perl?
132
55e174a4
JH
133Perltidy is a Perl script which indents and reformats Perl scripts
134to make them easier to read by trying to follow the rules of the
135L<perlstyle>. If you write Perl scripts, or spend much time reading
136them, you will probably find it useful. It is available at
137http://perltidy.sourceforge.net
138
139Of course, if you simply follow the guidelines in L<perlstyle>,
140you shouldn't need to reformat. The habit of formatting your code
141as you write it will help prevent bugs. Your editor can and should
142help you with this. The perl-mode or newer cperl-mode for emacs
143can provide remarkable amounts of help with most (but not all)
144code, and even less programmable editors can provide significant
145assistance. Tom Christiansen and many other VI users swear by
146the following settings in vi and its clones:
65acb1b1
TC
147
148 set ai sw=4
d92eb7b0 149 map! ^O {^M}^[O^T
65acb1b1 150
55e174a4 151Put that in your F<.exrc> file (replacing the caret characters
65acb1b1 152with control characters) and away you go. In insert mode, ^T is
a6dd486b 153for indenting, ^D is for undenting, and ^O is for blockdenting--
55e174a4 154as it were. A more complete example, with comments, can be found at
213329dd 155http://www.cpan.org/authors/id/TOMC/scripts/toms.exrc.gz
92c2ed05 156
f05bbc40 157The a2ps http://www-inf.enst.fr/%7Edemaille/a2ps/black+white.ps does
06a5f41f 158lots of things related to generating nicely printed output of
f05bbc40 159documents, as does enscript at http://people.ssh.fi/mtr/genscript/ .
65acb1b1 160
d92eb7b0 161=head2 Is there a ctags for Perl?
68dc0745 162
bc06af74
JH
163Recent versions of ctags do much more than older versions did.
164EXUBERANT CTAGS is available from http://ctags.sourceforge.net/
165and does a good job of making tags files for perl code.
166
167There is also a simple one at
a93751fa 168http://www.cpan.org/authors/id/TOMC/scripts/ptags.gz which may do
bc06af74 169the trick. It can be easy to hack this into what you want.
65acb1b1
TC
170
171=head2 Is there an IDE or Windows Perl Editor?
172
6641ed39
JH
173Perl programs are just plain text, so any editor will do.
174
6641ed39
JH
175If you're on Unix, you already have an IDE--Unix itself. The UNIX
176philosophy is the philosophy of several small tools that each do one
177thing and do it well. It's like a carpenter's toolbox.
178
5ca69f12 179If you want an IDE, check the following:
68fbfbd7
JH
180
181=over 4
182
68fbfbd7
JH
183=item Komodo
184
5ca69f12
JH
185ActiveState's cross-platform (as of April 2001 Windows and Linux),
186multi-language IDE has Perl support, including a regular expression
187debugger and remote debugging
f224927c 188( http://www.ActiveState.com/Products/Komodo/index.html ). (Visual
5ca69f12 189Perl, a Visual Studio.NET plug-in is currently (early 2001) in beta
1577cd80 190( http://www.ActiveState.com/Products/VisualPerl/index.html )).
68fbfbd7 191
06e809ab
JH
192=item The Object System
193
bfeeaf1b 194( http://www.castlelink.co.uk/object_system/ ) is a Perl web
06e809ab
JH
195applications development IDE, apparently for any platform
196that runs Perl.
197
ac1094a1
JH
198=item Open Perl IDE
199
200( http://open-perl-ide.sourceforge.net/ )
201Open Perl IDE is an integrated development environment for writing
202and debugging Perl scripts with ActiveState's ActivePerl distribution
203under Windows 95/98/NT/2000.
204
5ca69f12
JH
205=item PerlBuilder
206
f224927c 207( http://www.solutionsoft.com/perl.htm ) is an integrated development
5ca69f12 208environment for Windows that supports Perl development.
8782d048 209
68fbfbd7
JH
210=item visiPerl+
211
ac1094a1
JH
212( http://helpconsulting.net/visiperl/ )
213From Help Consulting, for Windows.
68fbfbd7
JH
214
215=back
216
06e809ab
JH
217For Windows there's also the
218
219=over 4
220
221=item CodeMagicCD
222
223( http://www.codemagiccd.com/ ) Collection of various programming
224tools for Windows: Perl (5.005_03), TclTk, Python, GNU programming
225tools, REBOL, wxWindows toolkit, the MinGW GNU C/C++ compiler, DJGPP
226GNU C/C++ compiler, Cint C interpreter, YaBasic.
227
228=back
229
5a13f98a 230For editors: if you're on Unix you probably have vi or a vi clone already,
6641ed39 231and possibly an emacs too, so you may not need to download anything.
5a13f98a 232In any emacs the cperl-mode (M-x cperl-mode) gives you perhaps the
6641ed39
JH
233best available Perl editing mode in any editor.
234
cc30d1a7
JH
235If you are using Windows, you can use any editor that lets
236you work with plain text, such as NotePad or WordPad. Word
237processors, such as Microsoft Word or WordPerfect, typically
238do not work since they insert all sorts of behind-the-scenes
239information, although some allow you to save files as "Text
240Only". You can also download text editors designed
241specifically for programming, such as Textpad
f224927c 242( http://www.textpad.com/ ) and UltraEdit
bfeeaf1b 243( http://www.ultraedit.com/ ), among others.
cc30d1a7
JH
244
245If you are using MacOS, the same concerns apply. MacPerl
246(for Classic environments) comes with a simple editor.
bfeeaf1b 247Popular external editors are BBEdit ( http://www.bbedit.com/ )
1577cd80 248or Alpha ( http://alpha.olm.net/ ). MacOS X users can use Unix
cc30d1a7 249editors as well.
68fbfbd7
JH
250
251=over 4
252
253=item GNU Emacs
254
255http://www.gnu.org/software/emacs/windows/ntemacs.html
256
257=item MicroEMACS
258
259http://members.nbci.com/uemacs/
260
261=item XEmacs
262
263http://www.xemacs.org/Download/index.html
264
265=back
266
267or a vi clone such as
268
269=over 4
270
271=item Elvis
272
273ftp://ftp.cs.pdx.edu/pub/elvis/ http://www.fh-wedel.de/elvis/
274
275=item Vile
276
277http://vile.cx/
278
279=item Vim
280
281http://www.vim.org/
282
283win32: http://www.cs.vu.nl/%7Etmgil/vi.html
284
285=back
286
5a13f98a 287For vi lovers in general, Windows or elsewhere:
f05bbc40
JH
288
289 http://www.thomer.com/thomer/vi/vi.html
6641ed39 290
f224927c 291nvi ( http://www.bostic.com/vi/ , available from CPAN in src/misc/) is
5a13f98a 292yet another vi clone, unfortunately not available for Windows, but in
6641ed39
JH
293UNIX platforms you might be interested in trying it out, firstly because
294strictly speaking it is not a vi clone, it is the real vi, or the new
295incarnation of it, and secondly because you can embed Perl inside it
296to use Perl as the scripting language. nvi is not alone in this,
7c82de66 297though: at least also vim and vile offer an embedded Perl.
614a1598 298
68fbfbd7
JH
299The following are Win32 multilanguage editor/IDESs that support Perl:
300
301=over 4
302
303=item Codewright
304
305http://www.starbase.com/
306
307=item MultiEdit
308
309http://www.MultiEdit.com/
310
311=item SlickEdit
312
313http://www.slickedit.com/
314
315=back
8782d048 316
6641ed39
JH
317There is also a toyedit Text widget based editor written in Perl
318that is distributed with the Tk module on CPAN. The ptkdb
f224927c 319( http://world.std.com/~aep/ptkdb/ ) is a Perl/tk based debugger that
8782d048 320acts as a development environment of sorts. Perl Composer
f224927c 321( http://perlcomposer.sourceforge.net/vperl.html ) is an IDE for Perl/Tk
e083a89c
JH
322GUI creation.
323
8782d048 324In addition to an editor/IDE you might be interested in a more
68fbfbd7
JH
325powerful shell environment for Win32. Your options include
326
327=over 4
328
329=item Bash
330
1577cd80 331from the Cygwin package ( http://sources.redhat.com/cygwin/ )
68fbfbd7
JH
332
333=item Ksh
334
f224927c 335from the MKS Toolkit ( http://www.mks.com/ ), or the Bourne shell of
1577cd80 336the U/WIN environment ( http://www.research.att.com/sw/tools/uwin/ )
68fbfbd7
JH
337
338=item Tcsh
339
f224927c 340ftp://ftp.astron.com/pub/tcsh/ , see also
68fbfbd7
JH
341http://www.primate.wisc.edu/software/csh-tcsh-book/
342
343=item Zsh
344
f224927c 345ftp://ftp.blarg.net/users/amol/zsh/ , see also http://www.zsh.org/
68fbfbd7
JH
346
347=back
348
614a1598
JH
349MKS and U/WIN are commercial (U/WIN is free for educational and
350research purposes), Cygwin is covered by the GNU Public License (but
351that shouldn't matter for Perl use). The Cygwin, MKS, and U/WIN all
352contain (in addition to the shells) a comprehensive set of standard
353UNIX toolkit utilities.
8782d048 354
5a13f98a
JH
355If you're transferring text files between Unix and Windows using FTP
356be sure to transfer them in ASCII mode so the ends of lines are
357appropriately converted.
358
e083a89c
JH
359On Mac OS the MacPerl Application comes with a simple 32k text editor
360that behaves like a rudimentary IDE. In contrast to the MacPerl Application
733271b5 361the MPW Perl tool can make use of the MPW Shell itself as an editor (with
68fbfbd7
JH
362no 32k limit).
363
364=over 4
365
366=item BBEdit and BBEdit Lite
367
368are text editors for Mac OS that have a Perl sensitivity mode
1577cd80 369( http://web.barebones.com/ ).
68fbfbd7
JH
370
371=item Alpha
372
373is an editor, written and extensible in Tcl, that nonetheless has
733271b5 374built in support for several popular markup and programming languages
1577cd80 375including Perl and HTML ( http://alpha.olm.net/ ).
68fbfbd7
JH
376
377=back
378
379Pepper and Pe are programming language sensitive text editors for Mac
1577cd80 380OS X and BeOS respectively ( http://www.hekkelman.com/ ).
68dc0745 381
382=head2 Where can I get Perl macros for vi?
383
384For a complete version of Tom Christiansen's vi configuration file,
a93751fa 385see http://www.cpan.org/authors/Tom_Christiansen/scripts/toms.exrc.gz ,
a6dd486b 386the standard benchmark file for vi emulators. The file runs best with nvi,
5a964f20 387the current version of vi out of Berkeley, which incidentally can be built
bfeeaf1b 388with an embedded Perl interpreter--see http://www.cpan.org/src/misc/ .
68dc0745 389
390=head2 Where can I get perl-mode for emacs?
391
392Since Emacs version 19 patchlevel 22 or so, there have been both a
87275199 393perl-mode.el and support for the Perl debugger built in. These should
68dc0745 394come with the standard Emacs 19 distribution.
395
87275199 396In the Perl source directory, you'll find a directory called "emacs",
68dc0745 397which contains a cperl-mode that color-codes keywords, provides
398context-sensitive help, and other nifty things.
399
92c2ed05 400Note that the perl-mode of emacs will have fits with C<"main'foo">
d92eb7b0 401(single quote), and mess up the indentation and highlighting. You
65acb1b1 402are probably using C<"main::foo"> in new Perl code anyway, so this
92c2ed05 403shouldn't be an issue.
68dc0745 404
405=head2 How can I use curses with Perl?
406
407The Curses module from CPAN provides a dynamically loadable object
5a964f20 408module interface to a curses library. A small demo can be found at the
1577cd80 409directory http://www.cpan.org/authors/Tom_Christiansen/scripts/rep ;
5a964f20
TC
410this program repeats a command and updates the screen as needed, rendering
411B<rep ps axu> similar to B<top>.
68dc0745 412
413=head2 How can I use X or Tk with Perl?
414
5a964f20
TC
415Tk is a completely Perl-based, object-oriented interface to the Tk toolkit
416that doesn't force you to use Tcl just to get at Tk. Sx is an interface
417to the Athena Widget set. Both are available from CPAN. See the
a93751fa 418directory http://www.cpan.org/modules/by-category/08_User_Interfaces/
68dc0745 419
a6dd486b 420Invaluable for Perl/Tk programming are the Perl/Tk FAQ at
87275199 421http://w4.lns.cornell.edu/%7Epvhp/ptk/ptkTOC.html , the Perl/Tk Reference
92c2ed05 422Guide available at
213329dd 423http://www.cpan.org/authors/Stephen_O_Lidie/ , and the
92c2ed05 424online manpages at
87275199 425http://www-users.cs.umn.edu/%7Eamundson/perl/perltk/toc.html .
92c2ed05 426
68dc0745 427=head2 How can I generate simple menus without using CGI or Tk?
428
a93751fa 429The http://www.cpan.org/authors/id/SKUNZ/perlmenu.v4.0.tar.gz
68dc0745 430module, which is curses-based, can help with this.
431
68dc0745 432=head2 How can I make my Perl program run faster?
433
92c2ed05 434The best way to do this is to come up with a better algorithm. This
b73a15ae 435can often make a dramatic difference. Jon Bentley's book
92c2ed05
GS
436``Programming Pearls'' (that's not a misspelling!) has some good tips
437on optimization, too. Advice on benchmarking boils down to: benchmark
438and profile to make sure you're optimizing the right part, look for
439better algorithms instead of microtuning your code, and when all else
57b19278
JS
440fails consider just buying faster hardware. You will probably want to
441read the answer to the earlier question ``How do I profile my Perl programs?''
442if you haven't done so already.
68dc0745 443
92c2ed05 444A different approach is to autoload seldom-used Perl code. See the
68dc0745 445AutoSplit and AutoLoader modules in the standard distribution for
446that. Or you could locate the bottleneck and think about writing just
447that part in C, the way we used to take bottlenecks in C code and
a6dd486b
JB
448write them in assembler. Similar to rewriting in C,
449modules that have critical sections can be written in C (for instance, the
68dc0745 450PDL module from CPAN).
451
452In some cases, it may be worth it to use the backend compiler to
453produce byte code (saving compilation time) or compile into C, which
454will certainly save compilation time and sometimes a small amount (but
455not much) execution time. See the question about compiling your Perl
92c2ed05
GS
456programs for more on the compiler--the wins aren't as obvious as you'd
457hope.
68dc0745 458
92c2ed05 459If you're currently linking your perl executable to a shared I<libc.so>,
68dc0745 460you can often gain a 10-25% performance benefit by rebuilding it to
461link with a static libc.a instead. This will make a bigger perl
462executable, but your Perl programs (and programmers) may thank you for
463it. See the F<INSTALL> file in the source distribution for more
464information.
465
466Unsubstantiated reports allege that Perl interpreters that use sfio
87275199 467outperform those that don't (for I/O intensive applications). To try
68dc0745 468this, see the F<INSTALL> file in the source distribution, especially
87275199 469the ``Selecting File I/O mechanisms'' section.
68dc0745 470
471The undump program was an old attempt to speed up your Perl program
472by storing the already-compiled form to disk. This is no longer
473a viable option, as it only worked on a few architectures, and
474wasn't a good solution anyway.
475
476=head2 How can I make my Perl program take less memory?
477
478When it comes to time-space tradeoffs, Perl nearly always prefers to
479throw memory at a problem. Scalars in Perl use more memory than
65acb1b1 480strings in C, arrays take more than that, and hashes use even more. While
68dc0745 481there's still a lot to be done, recent releases have been addressing
482these issues. For example, as of 5.004, duplicate hash keys are
483shared amongst all hashes using them, so require no reallocation.
484
485In some cases, using substr() or vec() to simulate arrays can be
486highly beneficial. For example, an array of a thousand booleans will
487take at least 20,000 bytes of space, but it can be turned into one
a6dd486b 488125-byte bit vector--a considerable memory savings. The standard
68dc0745 489Tie::SubstrHash module can also help for certain types of data
490structure. If you're working with specialist data structures
491(matrices, for instance) modules that implement these in C may use
492less memory than equivalent Perl modules.
493
494Another thing to try is learning whether your Perl was compiled with
54310121 495the system malloc or with Perl's builtin malloc. Whichever one it
68dc0745 496is, try using the other one and see whether this makes a difference.
497Information about malloc is in the F<INSTALL> file in the source
498distribution. You can find out whether you are using perl's malloc by
499typing C<perl -V:usemymalloc>.
500
24f1ba9b
JH
501Of course, the best way to save memory is to not do anything to waste
502it in the first place. Good programming practices can go a long way
503toward this:
504
505=over 4
506
507=item * Don't slurp!
508
509Don't read an entire file into memory if you can process it line
510by line. Or more concretely, use a loop like this:
511
512 #
513 # Good Idea
514 #
515 while (<FILE>) {
516 # ...
517 }
518
519instead of this:
520
521 #
522 # Bad Idea
523 #
524 @data = <FILE>;
525 foreach (@data) {
526 # ...
527 }
528
529When the files you're processing are small, it doesn't much matter which
530way you do it, but it makes a huge difference when they start getting
531larger.
532
bc06af74
JH
533=item * Use map and grep selectively
534
535Remember that both map and grep expect a LIST argument, so doing this:
536
537 @wanted = grep {/pattern/} <FILE>;
538
539will cause the entire file to be slurped. For large files, it's better
540to loop:
541
542 while (<FILE>) {
543 push(@wanted, $_) if /pattern/;
544 }
545
546=item * Avoid unnecessary quotes and stringification
547
548Don't quote large strings unless absolutely necessary:
549
550 my $copy = "$large_string";
551
552makes 2 copies of $large_string (one for $copy and another for the
553quotes), whereas
554
555 my $copy = $large_string;
556
557only makes one copy.
558
559Ditto for stringifying large arrays:
560
561 {
562 local $, = "\n";
563 print @big_array;
564 }
565
566is much more memory-efficient than either
567
568 print join "\n", @big_array;
569
570or
571
572 {
573 local $" = "\n";
574 print "@big_array";
575 }
576
577
24f1ba9b
JH
578=item * Pass by reference
579
580Pass arrays and hashes by reference, not by value. For one thing, it's
581the only way to pass multiple lists or hashes (or both) in a single
582call/return. It also avoids creating a copy of all the contents. This
583requires some judgment, however, because any changes will be propagated
584back to the original data. If you really want to mangle (er, modify) a
585copy, you'll have to sacrifice the memory needed to make one.
586
587=item * Tie large variables to disk.
588
589For "big" data stores (i.e. ones that exceed available memory) consider
590using one of the DB modules to store it on disk instead of in RAM. This
591will incur a penalty in access time, but that's probably better that
592causing your hard disk to thrash due to massive swapping.
593
594=back
595
68dc0745 596=head2 Is it unsafe to return a pointer to local data?
597
598No, Perl's garbage collection system takes care of this.
599
600 sub makeone {
601 my @a = ( 1 .. 10 );
602 return \@a;
603 }
604
605 for $i ( 1 .. 10 ) {
606 push @many, makeone();
607 }
608
609 print $many[4][5], "\n";
610
611 print "@many\n";
612
613=head2 How can I free an array or hash so my program shrinks?
614
c8db1d39
TC
615You can't. On most operating systems, memory allocated to a program
616can never be returned to the system. That's why long-running programs
65acb1b1
TC
617sometimes re-exec themselves. Some operating systems (notably,
618FreeBSD and Linux) allegedly reclaim large chunks of memory that is no
619longer used, but it doesn't appear to happen with Perl (yet). The Mac
620appears to be the only platform that will reliably (albeit, slowly)
621return memory to the OS.
622
623We've had reports that on Linux (Redhat 5.1) on Intel, C<undef
624$scalar> will return memory to the system, while on Solaris 2.6 it
625won't. In general, try it yourself and see.
68dc0745 626
627However, judicious use of my() on your variables will help make sure
a6dd486b 628that they go out of scope so that Perl can free up that space for
92c2ed05 629use in other parts of your program. A global variable, of course, never
68dc0745 630goes out of scope, so you can't get its space automatically reclaimed,
631although undef()ing and/or delete()ing it will achieve the same effect.
46fc3d4c 632In general, memory allocation and de-allocation isn't something you can
68dc0745 633or should be worrying about much in Perl, but even this capability
634(preallocation of data types) is in the works.
635
636=head2 How can I make my CGI script more efficient?
637
638Beyond the normal measures described to make general Perl programs
639faster or smaller, a CGI program has additional issues. It may be run
640several times per second. Given that each time it runs it will need
46fc3d4c 641to be re-compiled and will often allocate a megabyte or more of system
68dc0745 642memory, this can be a killer. Compiling into C B<isn't going to help
46fc3d4c 643you> because the process start-up overhead is where the bottleneck is.
68dc0745 644
92c2ed05
GS
645There are two popular ways to avoid this overhead. One solution
646involves running the Apache HTTP server (available from
f224927c 647http://www.apache.org/ ) with either of the mod_perl or mod_fastcgi
92c2ed05
GS
648plugin modules.
649
650With mod_perl and the Apache::Registry module (distributed with
651mod_perl), httpd will run with an embedded Perl interpreter which
652pre-compiles your script and then executes it within the same address
653space without forking. The Apache extension also gives Perl access to
654the internal server API, so modules written in Perl can do just about
655anything a module written in C can. For more on mod_perl, see
656http://perl.apache.org/
657
65acb1b1 658With the FCGI module (from CPAN) and the mod_fastcgi
bfeeaf1b 659module (available from http://www.fastcgi.com/ ) each of your Perl
87275199 660programs becomes a permanent CGI daemon process.
68dc0745 661
662Both of these solutions can have far-reaching effects on your system
87275199 663and on the way you write your CGI programs, so investigate them with
68dc0745 664care.
665
a93751fa 666See http://www.cpan.org/modules/by-category/15_World_Wide_Web_HTML_HTTP_CGI/ .
5a964f20 667
65acb1b1 668A non-free, commercial product, ``The Velocity Engine for Perl'',
a6dd486b
JB
669(http://www.binevolve.com/ or http://www.binevolve.com/velocigen/ )
670might also be worth looking at. It will allow you to increase the
671performance of your Perl programs, running programs up to 25 times
672faster than normal CGI Perl when running in persistent Perl mode or 4
673to 5 times faster without any modification to your existing CGI
674programs. Fully functional evaluation copies are available from the
675web site.
c8db1d39 676
68dc0745 677=head2 How can I hide the source for my Perl program?
678
679Delete it. :-) Seriously, there are a number of (mostly
92c2ed05 680unsatisfactory) solutions with varying levels of ``security''.
68dc0745 681
682First of all, however, you I<can't> take away read permission, because
683the source code has to be readable in order to be compiled and
684interpreted. (That doesn't mean that a CGI script's source is
a6dd486b
JB
685readable by people on the web, though--only by people with access to
686the filesystem.) So you have to leave the permissions at the socially
92c2ed05 687friendly 0755 level.
68dc0745 688
689Some people regard this as a security problem. If your program does
a6dd486b 690insecure things and relies on people not knowing how to exploit those
68dc0745 691insecurities, it is not secure. It is often possible for someone to
692determine the insecure things and exploit them without viewing the
693source. Security through obscurity, the name for hiding your bugs
694instead of fixing them, is little security indeed.
695
83df6a1d
JH
696You can try using encryption via source filters (Starting from Perl
6975.8 the Filter::Simple and Filter::Util::Call modules are included in
698the standard distribution), but any decent programmer will be able to
699decrypt it. You can try using the byte code compiler and interpreter
700described below, but the curious might still be able to de-compile it.
701You can try using the native-code compiler described below, but
702crackers might be able to disassemble it. These pose varying degrees
703of difficulty to people wanting to get at your code, but none can
704definitively conceal it (true of every language, not just Perl).
68dc0745 705
706If you're concerned about people profiting from your code, then the
d92eb7b0 707bottom line is that nothing but a restrictive license will give you
68dc0745 708legal security. License your software and pepper it with threatening
92c2ed05 709statements like ``This is unpublished proprietary software of XYZ Corp.
68dc0745 710Your access to it does not give you permission to use it blah blah
92c2ed05 711blah.'' We are not lawyers, of course, so you should see a lawyer if
d92eb7b0 712you want to be sure your license's wording will stand up in court.
68dc0745 713
54310121 714=head2 How can I compile my Perl program into byte code or C?
68dc0745 715
716Malcolm Beattie has written a multifunction backend compiler,
5e3006a4
GS
717available from CPAN, that can do both these things. It is included
718in the perl5.005 release, but is still considered experimental.
719This means it's fun to play with if you're a programmer but not
720really for people looking for turn-key solutions.
68dc0745 721
92c2ed05
GS
722Merely compiling into C does not in and of itself guarantee that your
723code will run very much faster. That's because except for lucky cases
724where a lot of native type inferencing is possible, the normal Perl
a6dd486b 725run-time system is still present and so your program will take just as
92c2ed05
GS
726long to run and be just as big. Most programs save little more than
727compilation time, leaving execution no more than 10-30% faster. A few
a6dd486b 728rare programs actually benefit significantly (even running several times
92c2ed05 729faster), but this takes some tweaking of your code.
68dc0745 730
68dc0745 731You'll probably be astonished to learn that the current version of the
732compiler generates a compiled form of your script whose executable is
733just as big as the original perl executable, and then some. That's
734because as currently written, all programs are prepared for a full
735eval() statement. You can tremendously reduce this cost by building a
92c2ed05 736shared I<libperl.so> library and linking against that. See the
87275199 737F<INSTALL> podfile in the Perl source distribution for details. If
d92eb7b0 738you link your main perl binary with this, it will make it minuscule.
92c2ed05 739For example, on one author's system, F</usr/bin/perl> is only 11k in
68dc0745 740size!
741
5a964f20 742In general, the compiler will do nothing to make a Perl program smaller,
a6dd486b
JB
743faster, more portable, or more secure. In fact, it can make your
744situation worse. The executable will be bigger, your VM system may take
5a964f20
TC
745longer to load the whole thing, the binary is fragile and hard to fix,
746and compilation never stopped software piracy in the form of crackers,
747viruses, or bootleggers. The real advantage of the compiler is merely
748packaging, and once you see the size of what it makes (well, unless
749you use a shared I<libperl.so>), you'll probably want a complete
5e3006a4 750Perl install anyway.
5a964f20 751
65acb1b1
TC
752=head2 How can I compile Perl into Java?
753
a6dd486b 754You can also integrate Java and Perl with the
65acb1b1 755Perl Resource Kit from O'Reilly and Associates. See
a6dd486b
JB
756http://www.oreilly.com/catalog/prkunix/ .
757
758Perl 5.6 comes with Java Perl Lingo, or JPL. JPL, still in
759development, allows Perl code to be called from Java. See jpl/README
760in the Perl source tree.
65acb1b1 761
92c2ed05 762=head2 How can I get C<#!perl> to work on [MS-DOS,NT,...]?
68dc0745 763
764For OS/2 just use
765
766 extproc perl -S -your_switches
767
768as the first line in C<*.cmd> file (C<-S> due to a bug in cmd.exe's
46fc3d4c 769`extproc' handling). For DOS one should first invent a corresponding
a6dd486b 770batch file and codify it in C<ALTERNATIVE_SHEBANG> (see the
68dc0745 771F<INSTALL> file in the source distribution for more information).
772
92c2ed05
GS
773The Win95/NT installation, when using the ActiveState port of Perl,
774will modify the Registry to associate the C<.pl> extension with the
d92eb7b0
GS
775perl interpreter. If you install another port, perhaps even building
776your own Win95/NT Perl from the standard sources by using a Windows port
d702ae42 777of gcc (e.g., with cygwin or mingw32), then you'll have to modify
d92eb7b0
GS
778the Registry yourself. In addition to associating C<.pl> with the
779interpreter, NT people can use: C<SET PATHEXT=%PATHEXT%;.PL> to let them
780run the program C<install-linux.pl> merely by typing C<install-linux>.
68dc0745 781
87275199
GS
782Macintosh Perl programs will have the appropriate Creator and
783Type, so that double-clicking them will invoke the Perl application.
68dc0745 784
785I<IMPORTANT!>: Whatever you do, PLEASE don't get frustrated, and just
786throw the perl interpreter into your cgi-bin directory, in order to
87275199 787get your programs working for a web server. This is an EXTREMELY big
68dc0745 788security risk. Take the time to figure out how to do it correctly.
789
87275199 790=head2 Can I write useful Perl programs on the command line?
68dc0745 791
792Yes. Read L<perlrun> for more information. Some examples follow.
793(These assume standard Unix shell quoting rules.)
794
795 # sum first and last fields
5a964f20 796 perl -lane 'print $F[0] + $F[-1]' *
68dc0745 797
798 # identify text files
799 perl -le 'for(@ARGV) {print if -f && -T _}' *
800
5a964f20 801 # remove (most) comments from C program
68dc0745 802 perl -0777 -pe 's{/\*.*?\*/}{}gs' foo.c
803
804 # make file a month younger than today, defeating reaper daemons
805 perl -e '$X=24*60*60; utime(time(),time() + 30 * $X,@ARGV)' *
806
807 # find first unused uid
808 perl -le '$i++ while getpwuid($i); print $i'
809
810 # display reasonable manpath
811 echo $PATH | perl -nl -072 -e '
812 s![^/+]*$!man!&&-d&&!$s{$_}++&&push@m,$_;END{print"@m"}'
813
87275199 814OK, the last one was actually an Obfuscated Perl Contest entry. :-)
68dc0745 815
87275199 816=head2 Why don't Perl one-liners work on my DOS/Mac/VMS system?
68dc0745 817
818The problem is usually that the command interpreters on those systems
819have rather different ideas about quoting than the Unix shells under
820which the one-liners were created. On some systems, you may have to
821change single-quotes to double ones, which you must I<NOT> do on Unix
822or Plan9 systems. You might also have to change a single % to a %%.
823
824For example:
825
826 # Unix
827 perl -e 'print "Hello world\n"'
828
46fc3d4c 829 # DOS, etc.
68dc0745 830 perl -e "print \"Hello world\n\""
831
46fc3d4c 832 # Mac
68dc0745 833 print "Hello world\n"
834 (then Run "Myscript" or Shift-Command-R)
835
d2321c93
JH
836 # MPW
837 perl -e 'print "Hello world\n"'
838
68dc0745 839 # VMS
840 perl -e "print ""Hello world\n"""
841
a6dd486b 842The problem is that none of these examples are reliable: they depend on the
92c2ed05 843command interpreter. Under Unix, the first two often work. Under DOS,
a6dd486b 844it's entirely possible that neither works. If 4DOS was the command shell,
92c2ed05 845you'd probably have better luck like this:
68dc0745 846
847 perl -e "print <Ctrl-x>"Hello world\n<Ctrl-x>""
848
46fc3d4c 849Under the Mac, it depends which environment you are using. The MacPerl
68dc0745 850shell, or MPW, is much like Unix shells in its support for several
46fc3d4c 851quoting variants, except that it makes free use of the Mac's non-ASCII
68dc0745 852characters as control characters.
853
65acb1b1
TC
854Using qq(), q(), and qx(), instead of "double quotes", 'single
855quotes', and `backticks`, may make one-liners easier to write.
856
d2321c93 857There is no general solution to all of this. It is a mess.
68dc0745 858
859[Some of this answer was contributed by Kenneth Albanowski.]
860
861=head2 Where can I learn about CGI or Web programming in Perl?
862
863For modules, get the CGI or LWP modules from CPAN. For textbooks,
864see the two especially dedicated to web stuff in the question on
92c2ed05
GS
865books. For problems and questions related to the web, like ``Why
866do I get 500 Errors'' or ``Why doesn't it run from the browser right
8305e449
JH
867when it runs fine on the command line'', see the troubleshooting
868guides and references in L<perlfaq9> or in the CGI MetaFAQ:
68dc0745 869
8305e449 870 http://www.perl.org/CGI_MetaFAQ.html
0f542199 871
68dc0745 872=head2 Where can I learn about object-oriented Perl programming?
873
a6dd486b 874A good place to start is L<perltoot>, and you can use L<perlobj>,
06a5f41f
JH
875L<perlboot>, L<perltoot>, L<perltooc>, and L<perlbot> for reference.
876(If you are using really old Perl, you may not have all of these,
877try http://www.perldoc.com/ , but consider upgrading your perl.)
878
879A good book on OO on Perl is the "Object-Oriented Perl"
880by Damian Conway from Manning Publications,
881http://www.manning.com/Conway/index.html
68dc0745 882
883=head2 Where can I learn about linking C with Perl? [h2xs, xsubpp]
884
885If you want to call C from Perl, start with L<perlxstut>,
886moving on to L<perlxs>, L<xsubpp>, and L<perlguts>. If you want to
887call Perl from C, then read L<perlembed>, L<perlcall>, and
888L<perlguts>. Don't forget that you can learn a lot from looking at
889how the authors of existing extension modules wrote their code and
890solved their problems.
891
892=head2 I've read perlembed, perlguts, etc., but I can't embed perl in
a6dd486b 893my C program; what am I doing wrong?
68dc0745 894
895Download the ExtUtils::Embed kit from CPAN and run `make test'. If
896the tests pass, read the pods again and again and again. If they
87275199 897fail, see L<perlbug> and send a bug report with the output of
68dc0745 898C<make test TEST_VERBOSE=1> along with C<perl -V>.
899
83ded9ee 900=head2 When I tried to run my script, I got this message. What does it mean?
68dc0745 901
87275199
GS
902A complete list of Perl's error messages and warnings with explanatory
903text can be found in L<perldiag>. You can also use the splain program
904(distributed with Perl) to explain the error messages:
68dc0745 905
906 perl program 2>diag.out
907 splain [-v] [-p] diag.out
908
909or change your program to explain the messages for you:
910
911 use diagnostics;
912
913or
914
915 use diagnostics -verbose;
916
917=head2 What's MakeMaker?
918
87275199 919This module (part of the standard Perl distribution) is designed to
68dc0745 920write a Makefile for an extension module from a Makefile.PL. For more
921information, see L<ExtUtils::MakeMaker>.
922
923=head1 AUTHOR AND COPYRIGHT
924
0bc0ad85 925Copyright (c) 1997-2002 Tom Christiansen and Nathan Torkington.
5a964f20
TC
926All rights reserved.
927
5a7beb56
JH
928This documentation is free; you can redistribute it and/or modify it
929under the same terms as Perl itself.
c8db1d39 930
87275199 931Irrespective of its distribution, all code examples here are in the public
c8db1d39
TC
932domain. You are permitted and encouraged to use this code and any
933derivatives thereof in your own programs for fun or for profit as you
934see fit. A simple comment in the code giving credit to the FAQ would
935be courteous but is not required.