This is a live mirror of the Perl 5 development currently hosted at https://github.com/perl/perl5
reentrant buffers
[perl5.git] / pod / perlop.pod
CommitLineData
a0d0e21e
LW
1=head1 NAME
2
3perlop - Perl operators and precedence
4
5=head1 SYNOPSIS
6
7Perl operators have the following associativity and precedence,
19799a22
GS
8listed from highest precedence to lowest. Operators borrowed from
9C keep the same precedence relationship with each other, even where
10C's precedence is slightly screwy. (This makes learning Perl easier
11for C folks.) With very few exceptions, these all operate on scalar
12values only, not array values.
a0d0e21e
LW
13
14 left terms and list operators (leftward)
15 left ->
16 nonassoc ++ --
17 right **
18 right ! ~ \ and unary + and -
54310121 19 left =~ !~
a0d0e21e
LW
20 left * / % x
21 left + - .
22 left << >>
23 nonassoc named unary operators
24 nonassoc < > <= >= lt gt le ge
25 nonassoc == != <=> eq ne cmp
26 left &
27 left | ^
28 left &&
c963b151 29 left || //
137443ea 30 nonassoc .. ...
a0d0e21e
LW
31 right ?:
32 right = += -= *= etc.
33 left , =>
34 nonassoc list operators (rightward)
a5f75d66 35 right not
a0d0e21e 36 left and
c963b151 37 left or xor err
a0d0e21e
LW
38
39In the following sections, these operators are covered in precedence order.
40
5a964f20
TC
41Many operators can be overloaded for objects. See L<overload>.
42
cb1a09d0 43=head1 DESCRIPTION
a0d0e21e
LW
44
45=head2 Terms and List Operators (Leftward)
46
62c18ce2 47A TERM has the highest precedence in Perl. They include variables,
5f05dabc 48quote and quote-like operators, any expression in parentheses,
a0d0e21e
LW
49and any function whose arguments are parenthesized. Actually, there
50aren't really functions in this sense, just list operators and unary
51operators behaving as functions because you put parentheses around
52the arguments. These are all documented in L<perlfunc>.
53
54If any list operator (print(), etc.) or any unary operator (chdir(), etc.)
55is followed by a left parenthesis as the next token, the operator and
56arguments within parentheses are taken to be of highest precedence,
57just like a normal function call.
58
59In the absence of parentheses, the precedence of list operators such as
60C<print>, C<sort>, or C<chmod> is either very high or very low depending on
54310121 61whether you are looking at the left side or the right side of the operator.
a0d0e21e
LW
62For example, in
63
64 @ary = (1, 3, sort 4, 2);
65 print @ary; # prints 1324
66
19799a22
GS
67the commas on the right of the sort are evaluated before the sort,
68but the commas on the left are evaluated after. In other words,
69list operators tend to gobble up all arguments that follow, and
a0d0e21e 70then act like a simple TERM with regard to the preceding expression.
19799a22 71Be careful with parentheses:
a0d0e21e
LW
72
73 # These evaluate exit before doing the print:
74 print($foo, exit); # Obviously not what you want.
75 print $foo, exit; # Nor is this.
76
77 # These do the print before evaluating exit:
78 (print $foo), exit; # This is what you want.
79 print($foo), exit; # Or this.
80 print ($foo), exit; # Or even this.
81
82Also note that
83
84 print ($foo & 255) + 1, "\n";
85
54310121 86probably doesn't do what you expect at first glance. See
a0d0e21e
LW
87L<Named Unary Operators> for more discussion of this.
88
89Also parsed as terms are the C<do {}> and C<eval {}> constructs, as
54310121 90well as subroutine and method calls, and the anonymous
a0d0e21e
LW
91constructors C<[]> and C<{}>.
92
2ae324a7 93See also L<Quote and Quote-like Operators> toward the end of this section,
c07a80fd 94as well as L<"I/O Operators">.
a0d0e21e
LW
95
96=head2 The Arrow Operator
97
35f2feb0 98"C<< -> >>" is an infix dereference operator, just as it is in C
19799a22
GS
99and C++. If the right side is either a C<[...]>, C<{...}>, or a
100C<(...)> subscript, then the left side must be either a hard or
101symbolic reference to an array, a hash, or a subroutine respectively.
102(Or technically speaking, a location capable of holding a hard
103reference, if it's an array or hash reference being used for
104assignment.) See L<perlreftut> and L<perlref>.
a0d0e21e 105
19799a22
GS
106Otherwise, the right side is a method name or a simple scalar
107variable containing either the method name or a subroutine reference,
108and the left side must be either an object (a blessed reference)
109or a class name (that is, a package name). See L<perlobj>.
a0d0e21e 110
5f05dabc 111=head2 Auto-increment and Auto-decrement
a0d0e21e
LW
112
113"++" and "--" work as in C. That is, if placed before a variable, they
114increment or decrement the variable before returning the value, and if
115placed after, increment or decrement the variable after returning the value.
116
54310121 117The auto-increment operator has a little extra builtin magic to it. If
a0d0e21e
LW
118you increment a variable that is numeric, or that has ever been used in
119a numeric context, you get a normal increment. If, however, the
5f05dabc 120variable has been used in only string contexts since it was set, and
5a964f20 121has a value that is not the empty string and matches the pattern
9c0670e1 122C</^[a-zA-Z]*[0-9]*\z/>, the increment is done as a string, preserving each
a0d0e21e
LW
123character within its range, with carry:
124
125 print ++($foo = '99'); # prints '100'
126 print ++($foo = 'a0'); # prints 'a1'
127 print ++($foo = 'Az'); # prints 'Ba'
128 print ++($foo = 'zz'); # prints 'aaa'
129
5f05dabc 130The auto-decrement operator is not magical.
a0d0e21e
LW
131
132=head2 Exponentiation
133
19799a22 134Binary "**" is the exponentiation operator. It binds even more
cb1a09d0
AD
135tightly than unary minus, so -2**4 is -(2**4), not (-2)**4. (This is
136implemented using C's pow(3) function, which actually works on doubles
137internally.)
a0d0e21e
LW
138
139=head2 Symbolic Unary Operators
140
5f05dabc 141Unary "!" performs logical negation, i.e., "not". See also C<not> for a lower
a0d0e21e
LW
142precedence version of this.
143
144Unary "-" performs arithmetic negation if the operand is numeric. If
145the operand is an identifier, a string consisting of a minus sign
146concatenated with the identifier is returned. Otherwise, if the string
147starts with a plus or minus, a string starting with the opposite sign
148is returned. One effect of these rules is that C<-bareword> is equivalent
149to C<"-bareword">.
150
972b05a9
JH
151Unary "~" performs bitwise negation, i.e., 1's complement. For
152example, C<0666 & ~027> is 0640. (See also L<Integer Arithmetic> and
153L<Bitwise String Operators>.) Note that the width of the result is
154platform-dependent: ~0 is 32 bits wide on a 32-bit platform, but 64
155bits wide on a 64-bit platform, so if you are expecting a certain bit
156width, remember use the & operator to mask off the excess bits.
a0d0e21e
LW
157
158Unary "+" has no effect whatsoever, even on strings. It is useful
159syntactically for separating a function name from a parenthesized expression
160that would otherwise be interpreted as the complete list of function
5ba421f6 161arguments. (See examples above under L<Terms and List Operators (Leftward)>.)
a0d0e21e 162
19799a22
GS
163Unary "\" creates a reference to whatever follows it. See L<perlreftut>
164and L<perlref>. Do not confuse this behavior with the behavior of
165backslash within a string, although both forms do convey the notion
166of protecting the next thing from interpolation.
a0d0e21e
LW
167
168=head2 Binding Operators
169
c07a80fd 170Binary "=~" binds a scalar expression to a pattern match. Certain operations
cb1a09d0
AD
171search or modify the string $_ by default. This operator makes that kind
172of operation work on some other string. The right argument is a search
2c268ad5
TP
173pattern, substitution, or transliteration. The left argument is what is
174supposed to be searched, substituted, or transliterated instead of the default
f8bab1e9
GS
175$_. When used in scalar context, the return value generally indicates the
176success of the operation. Behavior in list context depends on the particular
177operator. See L</"Regexp Quote-Like Operators"> for details.
178
179If the right argument is an expression rather than a search pattern,
2c268ad5 180substitution, or transliteration, it is interpreted as a search pattern at run
2decb4fb
GS
181time. This can be less efficient than an explicit search, because the
182pattern must be compiled every time the expression is evaluated.
a0d0e21e
LW
183
184Binary "!~" is just like "=~" except the return value is negated in
185the logical sense.
186
187=head2 Multiplicative Operators
188
189Binary "*" multiplies two numbers.
190
191Binary "/" divides two numbers.
192
54310121 193Binary "%" computes the modulus of two numbers. Given integer
194operands C<$a> and C<$b>: If C<$b> is positive, then C<$a % $b> is
195C<$a> minus the largest multiple of C<$b> that is not greater than
196C<$a>. If C<$b> is negative, then C<$a % $b> is C<$a> minus the
197smallest multiple of C<$b> that is not less than C<$a> (i.e. the
6bb4e6d4 198result will be less than or equal to zero).
f3798619 199Note than when C<use integer> is in scope, "%" gives you direct access
55d729e4
GS
200to the modulus operator as implemented by your C compiler. This
201operator is not as well defined for negative operands, but it will
202execute faster.
203
62d10b70
GS
204Binary "x" is the repetition operator. In scalar context or if the left
205operand is not enclosed in parentheses, it returns a string consisting
206of the left operand repeated the number of times specified by the right
207operand. In list context, if the left operand is enclosed in
208parentheses, it repeats the list.
a0d0e21e
LW
209
210 print '-' x 80; # print row of dashes
211
212 print "\t" x ($tab/8), ' ' x ($tab%8); # tab over
213
214 @ones = (1) x 80; # a list of 80 1's
215 @ones = (5) x @ones; # set all elements to 5
216
217
218=head2 Additive Operators
219
220Binary "+" returns the sum of two numbers.
221
222Binary "-" returns the difference of two numbers.
223
224Binary "." concatenates two strings.
225
226=head2 Shift Operators
227
55497cff 228Binary "<<" returns the value of its left argument shifted left by the
229number of bits specified by the right argument. Arguments should be
982ce180 230integers. (See also L<Integer Arithmetic>.)
a0d0e21e 231
55497cff 232Binary ">>" returns the value of its left argument shifted right by
233the number of bits specified by the right argument. Arguments should
982ce180 234be integers. (See also L<Integer Arithmetic>.)
a0d0e21e 235
b16cf6df
JH
236Note that both "<<" and ">>" in Perl are implemented directly using
237"<<" and ">>" in C. If C<use integer> (see L<Integer Arithmetic>) is
238in force then signed C integers are used, else unsigned C integers are
239used. Either way, the implementation isn't going to generate results
240larger than the size of the integer type Perl was built with (32 bits
241or 64 bits).
242
243The result of overflowing the range of the integers is undefined
244because it is undefined also in C. In other words, using 32-bit
245integers, C<< 1 << 32 >> is undefined. Shifting by a negative number
246of bits is also undefined.
247
a0d0e21e
LW
248=head2 Named Unary Operators
249
250The various named unary operators are treated as functions with one
251argument, with optional parentheses. These include the filetest
252operators, like C<-f>, C<-M>, etc. See L<perlfunc>.
253
254If any list operator (print(), etc.) or any unary operator (chdir(), etc.)
255is followed by a left parenthesis as the next token, the operator and
256arguments within parentheses are taken to be of highest precedence,
3981b0eb
JA
257just like a normal function call. For example,
258because named unary operators are higher precedence than ||:
a0d0e21e
LW
259
260 chdir $foo || die; # (chdir $foo) || die
261 chdir($foo) || die; # (chdir $foo) || die
262 chdir ($foo) || die; # (chdir $foo) || die
263 chdir +($foo) || die; # (chdir $foo) || die
264
3981b0eb 265but, because * is higher precedence than named operators:
a0d0e21e
LW
266
267 chdir $foo * 20; # chdir ($foo * 20)
268 chdir($foo) * 20; # (chdir $foo) * 20
269 chdir ($foo) * 20; # (chdir $foo) * 20
270 chdir +($foo) * 20; # chdir ($foo * 20)
271
272 rand 10 * 20; # rand (10 * 20)
273 rand(10) * 20; # (rand 10) * 20
274 rand (10) * 20; # (rand 10) * 20
275 rand +(10) * 20; # rand (10 * 20)
276
5ba421f6 277See also L<"Terms and List Operators (Leftward)">.
a0d0e21e
LW
278
279=head2 Relational Operators
280
35f2feb0 281Binary "<" returns true if the left argument is numerically less than
a0d0e21e
LW
282the right argument.
283
35f2feb0 284Binary ">" returns true if the left argument is numerically greater
a0d0e21e
LW
285than the right argument.
286
35f2feb0 287Binary "<=" returns true if the left argument is numerically less than
a0d0e21e
LW
288or equal to the right argument.
289
35f2feb0 290Binary ">=" returns true if the left argument is numerically greater
a0d0e21e
LW
291than or equal to the right argument.
292
293Binary "lt" returns true if the left argument is stringwise less than
294the right argument.
295
296Binary "gt" returns true if the left argument is stringwise greater
297than the right argument.
298
299Binary "le" returns true if the left argument is stringwise less than
300or equal to the right argument.
301
302Binary "ge" returns true if the left argument is stringwise greater
303than or equal to the right argument.
304
305=head2 Equality Operators
306
307Binary "==" returns true if the left argument is numerically equal to
308the right argument.
309
310Binary "!=" returns true if the left argument is numerically not equal
311to the right argument.
312
35f2feb0 313Binary "<=>" returns -1, 0, or 1 depending on whether the left
6ee5d4e7 314argument is numerically less than, equal to, or greater than the right
d4ad863d 315argument. If your platform supports NaNs (not-a-numbers) as numeric
7d3a9d88
NC
316values, using them with "<=>" returns undef. NaN is not "<", "==", ">",
317"<=" or ">=" anything (even NaN), so those 5 return false. NaN != NaN
318returns true, as does NaN != anything else. If your platform doesn't
319support NaNs then NaN is just a string with numeric value 0.
320
321 perl -le '$a = NaN; print "No NaN support here" if $a == $a'
322 perl -le '$a = NaN; print "NaN support here" if $a != $a'
a0d0e21e
LW
323
324Binary "eq" returns true if the left argument is stringwise equal to
325the right argument.
326
327Binary "ne" returns true if the left argument is stringwise not equal
328to the right argument.
329
d4ad863d
JH
330Binary "cmp" returns -1, 0, or 1 depending on whether the left
331argument is stringwise less than, equal to, or greater than the right
332argument.
a0d0e21e 333
a034a98d
DD
334"lt", "le", "ge", "gt" and "cmp" use the collation (sort) order specified
335by the current locale if C<use locale> is in effect. See L<perllocale>.
336
a0d0e21e
LW
337=head2 Bitwise And
338
2cdc098b 339Binary "&" returns its operands ANDed together bit by bit.
2c268ad5 340(See also L<Integer Arithmetic> and L<Bitwise String Operators>.)
a0d0e21e 341
2cdc098b
MG
342Note that "&" has lower priority than relational operators, so for example
343the brackets are essential in a test like
344
345 print "Even\n" if ($x & 1) == 0;
346
a0d0e21e
LW
347=head2 Bitwise Or and Exclusive Or
348
2cdc098b 349Binary "|" returns its operands ORed together bit by bit.
2c268ad5 350(See also L<Integer Arithmetic> and L<Bitwise String Operators>.)
a0d0e21e 351
2cdc098b 352Binary "^" returns its operands XORed together bit by bit.
2c268ad5 353(See also L<Integer Arithmetic> and L<Bitwise String Operators>.)
a0d0e21e 354
2cdc098b
MG
355Note that "|" and "^" have lower priority than relational operators, so
356for example the brackets are essential in a test like
357
358 print "false\n" if (8 | 2) != 10;
359
a0d0e21e
LW
360=head2 C-style Logical And
361
362Binary "&&" performs a short-circuit logical AND operation. That is,
363if the left operand is false, the right operand is not even evaluated.
364Scalar or list context propagates down to the right operand if it
365is evaluated.
366
367=head2 C-style Logical Or
368
369Binary "||" performs a short-circuit logical OR operation. That is,
370if the left operand is true, the right operand is not even evaluated.
371Scalar or list context propagates down to the right operand if it
372is evaluated.
373
c963b151
BD
374=head2 C-style Logical Defined-Or
375
376Although it has no direct equivalent in C, Perl's C<//> operator is related
377to its C-style or. In fact, it's exactly the same as C<||>, except that it
378tests the left hand side's definedness instead of its truth. Thus, C<$a // $b>
379is similar to C<defined($a) || $b> (except that it returns the value of C<$a>
380rather than the value of C<defined($a)>) and is exactly equivalent to
381C<defined($a) ? $a : $b>. This is very useful for providing default values
382for variables. If you actually want to test if at least one of C<$a> and C<$b> is
383defined, use C<defined($a // $b)>.
384
385The C<||>, C<//> and C<&&> operators differ from C's in that, rather than returning
a0d0e21e 3860 or 1, they return the last value evaluated. Thus, a reasonably portable
c963b151 387way to find out the home directory might be:
a0d0e21e 388
c963b151
BD
389 $home = $ENV{'HOME'} // $ENV{'LOGDIR'} //
390 (getpwuid($<))[7] // die "You're homeless!\n";
a0d0e21e 391
5a964f20
TC
392In particular, this means that you shouldn't use this
393for selecting between two aggregates for assignment:
394
395 @a = @b || @c; # this is wrong
396 @a = scalar(@b) || @c; # really meant this
397 @a = @b ? @b : @c; # this works fine, though
398
c963b151
BD
399As more readable alternatives to C<&&>, C<//> and C<||> when used for
400control flow, Perl provides C<and>, C<err> and C<or> operators (see below).
401The short-circuit behavior is identical. The precedence of "and", "err"
402and "or" is much lower, however, so that you can safely use them after a
5a964f20 403list operator without the need for parentheses:
a0d0e21e
LW
404
405 unlink "alpha", "beta", "gamma"
406 or gripe(), next LINE;
407
408With the C-style operators that would have been written like this:
409
410 unlink("alpha", "beta", "gamma")
411 || (gripe(), next LINE);
412
eeb6a2c9 413Using "or" for assignment is unlikely to do what you want; see below.
5a964f20
TC
414
415=head2 Range Operators
a0d0e21e
LW
416
417Binary ".." is the range operator, which is really two different
5a964f20 418operators depending on the context. In list context, it returns an
54ae734e 419list of values counting (up by ones) from the left value to the right
2cdbc966
JD
420value. If the left value is greater than the right value then it
421returns the empty array. The range operator is useful for writing
54ae734e 422C<foreach (1..10)> loops and for doing slice operations on arrays. In
2cdbc966
JD
423the current implementation, no temporary array is created when the
424range operator is used as the expression in C<foreach> loops, but older
425versions of Perl might burn a lot of memory when you write something
426like this:
a0d0e21e
LW
427
428 for (1 .. 1_000_000) {
429 # code
54310121 430 }
a0d0e21e 431
54ae734e
MG
432The range operator also works on strings, using the magical auto-increment,
433see below.
434
5a964f20 435In scalar context, ".." returns a boolean value. The operator is
a0d0e21e
LW
436bistable, like a flip-flop, and emulates the line-range (comma) operator
437of B<sed>, B<awk>, and various editors. Each ".." operator maintains its
438own boolean state. It is false as long as its left operand is false.
439Once the left operand is true, the range operator stays true until the
440right operand is true, I<AFTER> which the range operator becomes false
19799a22 441again. It doesn't become false till the next time the range operator is
a0d0e21e
LW
442evaluated. It can test the right operand and become false on the same
443evaluation it became true (as in B<awk>), but it still returns true once.
19799a22
GS
444If you don't want it to test the right operand till the next
445evaluation, as in B<sed>, just use three dots ("...") instead of
446two. In all other regards, "..." behaves just like ".." does.
447
448The right operand is not evaluated while the operator is in the
449"false" state, and the left operand is not evaluated while the
450operator is in the "true" state. The precedence is a little lower
451than || and &&. The value returned is either the empty string for
452false, or a sequence number (beginning with 1) for true. The
453sequence number is reset for each range encountered. The final
454sequence number in a range has the string "E0" appended to it, which
455doesn't affect its numeric value, but gives you something to search
456for if you want to exclude the endpoint. You can exclude the
457beginning point by waiting for the sequence number to be greater
458than 1. If either operand of scalar ".." is a constant expression,
459that operand is implicitly compared to the C<$.> variable, the
460current line number. Examples:
a0d0e21e
LW
461
462As a scalar operator:
463
464 if (101 .. 200) { print; } # print 2nd hundred lines
465 next line if (1 .. /^$/); # skip header lines
466 s/^/> / if (/^$/ .. eof()); # quote body
467
5a964f20
TC
468 # parse mail messages
469 while (<>) {
470 $in_header = 1 .. /^$/;
471 $in_body = /^$/ .. eof();
472 # do something based on those
473 } continue {
474 close ARGV if eof; # reset $. each file
475 }
476
a0d0e21e
LW
477As a list operator:
478
479 for (101 .. 200) { print; } # print $_ 100 times
3e3baf6d 480 @foo = @foo[0 .. $#foo]; # an expensive no-op
a0d0e21e
LW
481 @foo = @foo[$#foo-4 .. $#foo]; # slice last 5 items
482
5a964f20 483The range operator (in list context) makes use of the magical
5f05dabc 484auto-increment algorithm if the operands are strings. You
a0d0e21e
LW
485can say
486
487 @alphabet = ('A' .. 'Z');
488
54ae734e 489to get all normal letters of the English alphabet, or
a0d0e21e
LW
490
491 $hexdigit = (0 .. 9, 'a' .. 'f')[$num & 15];
492
493to get a hexadecimal digit, or
494
495 @z2 = ('01' .. '31'); print $z2[$mday];
496
497to get dates with leading zeros. If the final value specified is not
498in the sequence that the magical increment would produce, the sequence
499goes until the next value would be longer than the final value
500specified.
501
502=head2 Conditional Operator
503
504Ternary "?:" is the conditional operator, just as in C. It works much
505like an if-then-else. If the argument before the ? is true, the
506argument before the : is returned, otherwise the argument after the :
cb1a09d0
AD
507is returned. For example:
508
54310121 509 printf "I have %d dog%s.\n", $n,
cb1a09d0
AD
510 ($n == 1) ? '' : "s";
511
512Scalar or list context propagates downward into the 2nd
54310121 513or 3rd argument, whichever is selected.
cb1a09d0
AD
514
515 $a = $ok ? $b : $c; # get a scalar
516 @a = $ok ? @b : @c; # get an array
517 $a = $ok ? @b : @c; # oops, that's just a count!
518
519The operator may be assigned to if both the 2nd and 3rd arguments are
520legal lvalues (meaning that you can assign to them):
a0d0e21e
LW
521
522 ($a_or_b ? $a : $b) = $c;
523
5a964f20
TC
524Because this operator produces an assignable result, using assignments
525without parentheses will get you in trouble. For example, this:
526
527 $a % 2 ? $a += 10 : $a += 2
528
529Really means this:
530
531 (($a % 2) ? ($a += 10) : $a) += 2
532
533Rather than this:
534
535 ($a % 2) ? ($a += 10) : ($a += 2)
536
19799a22
GS
537That should probably be written more simply as:
538
539 $a += ($a % 2) ? 10 : 2;
540
4633a7c4 541=head2 Assignment Operators
a0d0e21e
LW
542
543"=" is the ordinary assignment operator.
544
545Assignment operators work as in C. That is,
546
547 $a += 2;
548
549is equivalent to
550
551 $a = $a + 2;
552
553although without duplicating any side effects that dereferencing the lvalue
54310121 554might trigger, such as from tie(). Other assignment operators work similarly.
555The following are recognized:
a0d0e21e
LW
556
557 **= += *= &= <<= &&=
558 -= /= |= >>= ||=
559 .= %= ^=
560 x=
561
19799a22 562Although these are grouped by family, they all have the precedence
a0d0e21e
LW
563of assignment.
564
b350dd2f
GS
565Unlike in C, the scalar assignment operator produces a valid lvalue.
566Modifying an assignment is equivalent to doing the assignment and
567then modifying the variable that was assigned to. This is useful
568for modifying a copy of something, like this:
a0d0e21e
LW
569
570 ($tmp = $global) =~ tr [A-Z] [a-z];
571
572Likewise,
573
574 ($a += 2) *= 3;
575
576is equivalent to
577
578 $a += 2;
579 $a *= 3;
580
b350dd2f
GS
581Similarly, a list assignment in list context produces the list of
582lvalues assigned to, and a list assignment in scalar context returns
583the number of elements produced by the expression on the right hand
584side of the assignment.
585
748a9306 586=head2 Comma Operator
a0d0e21e 587
5a964f20 588Binary "," is the comma operator. In scalar context it evaluates
a0d0e21e
LW
589its left argument, throws that value away, then evaluates its right
590argument and returns that value. This is just like C's comma operator.
591
5a964f20 592In list context, it's just the list argument separator, and inserts
a0d0e21e
LW
593both its arguments into the list.
594
35f2feb0 595The => digraph is mostly just a synonym for the comma operator. It's useful for
cb1a09d0 596documenting arguments that come in pairs. As of release 5.001, it also forces
4633a7c4 597any word to the left of it to be interpreted as a string.
748a9306 598
a0d0e21e
LW
599=head2 List Operators (Rightward)
600
601On the right side of a list operator, it has very low precedence,
602such that it controls all comma-separated expressions found there.
603The only operators with lower precedence are the logical operators
604"and", "or", and "not", which may be used to evaluate calls to list
605operators without the need for extra parentheses:
606
607 open HANDLE, "filename"
608 or die "Can't open: $!\n";
609
5ba421f6 610See also discussion of list operators in L<Terms and List Operators (Leftward)>.
a0d0e21e
LW
611
612=head2 Logical Not
613
614Unary "not" returns the logical negation of the expression to its right.
615It's the equivalent of "!" except for the very low precedence.
616
617=head2 Logical And
618
619Binary "and" returns the logical conjunction of the two surrounding
620expressions. It's equivalent to && except for the very low
5f05dabc 621precedence. This means that it short-circuits: i.e., the right
a0d0e21e
LW
622expression is evaluated only if the left expression is true.
623
c963b151 624=head2 Logical or, Defined or, and Exclusive Or
a0d0e21e
LW
625
626Binary "or" returns the logical disjunction of the two surrounding
5a964f20
TC
627expressions. It's equivalent to || except for the very low precedence.
628This makes it useful for control flow
629
630 print FH $data or die "Can't write to FH: $!";
631
632This means that it short-circuits: i.e., the right expression is evaluated
633only if the left expression is false. Due to its precedence, you should
634probably avoid using this for assignment, only for control flow.
635
636 $a = $b or $c; # bug: this is wrong
637 ($a = $b) or $c; # really means this
638 $a = $b || $c; # better written this way
639
19799a22 640However, when it's a list-context assignment and you're trying to use
5a964f20
TC
641"||" for control flow, you probably need "or" so that the assignment
642takes higher precedence.
643
644 @info = stat($file) || die; # oops, scalar sense of stat!
645 @info = stat($file) or die; # better, now @info gets its due
646
c963b151
BD
647Then again, you could always use parentheses.
648
649Binary "err" is equivalent to C<//>--it's just like binary "or", except it tests
650its left argument's definedness instead of its truth. There are two ways to
651remember "err": either because many functions return C<undef> on an B<err>or,
652or as a sort of correction: C<$a=($b err 'default')>
a0d0e21e
LW
653
654Binary "xor" returns the exclusive-OR of the two surrounding expressions.
655It cannot short circuit, of course.
656
657=head2 C Operators Missing From Perl
658
659Here is what C has that Perl doesn't:
660
661=over 8
662
663=item unary &
664
665Address-of operator. (But see the "\" operator for taking a reference.)
666
667=item unary *
668
54310121 669Dereference-address operator. (Perl's prefix dereferencing
a0d0e21e
LW
670operators are typed: $, @, %, and &.)
671
672=item (TYPE)
673
19799a22 674Type-casting operator.
a0d0e21e
LW
675
676=back
677
5f05dabc 678=head2 Quote and Quote-like Operators
a0d0e21e
LW
679
680While we usually think of quotes as literal values, in Perl they
681function as operators, providing various kinds of interpolating and
682pattern matching capabilities. Perl provides customary quote characters
683for these behaviors, but also provides a way for you to choose your
684quote character for any of them. In the following table, a C<{}> represents
87275199 685any pair of delimiters you choose.
a0d0e21e 686
2c268ad5
TP
687 Customary Generic Meaning Interpolates
688 '' q{} Literal no
689 "" qq{} Literal yes
af9219ee 690 `` qx{} Command yes*
2c268ad5 691 qw{} Word list no
af9219ee
MG
692 // m{} Pattern match yes*
693 qr{} Pattern yes*
694 s{}{} Substitution yes*
2c268ad5 695 tr{}{} Transliteration no (but see below)
7e3b091d 696 <<EOF here-doc yes*
a0d0e21e 697
af9219ee
MG
698 * unless the delimiter is ''.
699
87275199
GS
700Non-bracketing delimiters use the same character fore and aft, but the four
701sorts of brackets (round, angle, square, curly) will all nest, which means
702that
703
704 q{foo{bar}baz}
35f2feb0 705
87275199
GS
706is the same as
707
708 'foo{bar}baz'
709
710Note, however, that this does not always work for quoting Perl code:
711
712 $s = q{ if($a eq "}") ... }; # WRONG
713
83df6a1d
JH
714is a syntax error. The C<Text::Balanced> module (from CPAN, and
715starting from Perl 5.8 part of the standard distribution) is able
716to do this properly.
87275199 717
19799a22 718There can be whitespace between the operator and the quoting
fb73857a 719characters, except when C<#> is being used as the quoting character.
19799a22
GS
720C<q#foo#> is parsed as the string C<foo>, while C<q #foo#> is the
721operator C<q> followed by a comment. Its argument will be taken
722from the next line. This allows you to write:
fb73857a 723
724 s {foo} # Replace foo
725 {bar} # with bar.
726
904501ec
MG
727The following escape sequences are available in constructs that interpolate
728and in transliterations.
a0d0e21e 729
6ee5d4e7 730 \t tab (HT, TAB)
5a964f20 731 \n newline (NL)
6ee5d4e7 732 \r return (CR)
733 \f form feed (FF)
734 \b backspace (BS)
735 \a alarm (bell) (BEL)
736 \e escape (ESC)
a0ed51b3
LW
737 \033 octal char (ESC)
738 \x1b hex char (ESC)
739 \x{263a} wide hex char (SMILEY)
19799a22 740 \c[ control char (ESC)
95cc3e0c 741 \N{name} named Unicode character
2c268ad5 742
904501ec
MG
743The following escape sequences are available in constructs that interpolate
744but not in transliterations.
745
a0d0e21e
LW
746 \l lowercase next char
747 \u uppercase next char
748 \L lowercase till \E
749 \U uppercase till \E
750 \E end case modification
1d2dff63 751 \Q quote non-word characters till \E
a0d0e21e 752
95cc3e0c
JH
753If C<use locale> is in effect, the case map used by C<\l>, C<\L>,
754C<\u> and C<\U> is taken from the current locale. See L<perllocale>.
755If Unicode (for example, C<\N{}> or wide hex characters of 0x100 or
756beyond) is being used, the case map used by C<\l>, C<\L>, C<\u> and
757C<\U> is as defined by Unicode. For documentation of C<\N{name}>,
758see L<charnames>.
a034a98d 759
5a964f20
TC
760All systems use the virtual C<"\n"> to represent a line terminator,
761called a "newline". There is no such thing as an unvarying, physical
19799a22 762newline character. It is only an illusion that the operating system,
5a964f20
TC
763device drivers, C libraries, and Perl all conspire to preserve. Not all
764systems read C<"\r"> as ASCII CR and C<"\n"> as ASCII LF. For example,
765on a Mac, these are reversed, and on systems without line terminator,
766printing C<"\n"> may emit no actual data. In general, use C<"\n"> when
767you mean a "newline" for your system, but use the literal ASCII when you
768need an exact character. For example, most networking protocols expect
2a380090 769and prefer a CR+LF (C<"\015\012"> or C<"\cM\cJ">) for line terminators,
5a964f20
TC
770and although they often accept just C<"\012">, they seldom tolerate just
771C<"\015">. If you get in the habit of using C<"\n"> for networking,
772you may be burned some day.
773
904501ec
MG
774For constructs that do interpolate, variables beginning with "C<$>"
775or "C<@>" are interpolated. Subscripted variables such as C<$a[3]> or
776C<$href->{key}[0]> are also interpolated, as are array and hash slices.
777But method calls such as C<$obj->meth> are not.
af9219ee
MG
778
779Interpolating an array or slice interpolates the elements in order,
780separated by the value of C<$">, so is equivalent to interpolating
904501ec
MG
781C<join $", @array>. "Punctuation" arrays such as C<@+> are only
782interpolated if the name is enclosed in braces C<@{+}>.
af9219ee 783
1d2dff63
GS
784You cannot include a literal C<$> or C<@> within a C<\Q> sequence.
785An unescaped C<$> or C<@> interpolates the corresponding variable,
786while escaping will cause the literal string C<\$> to be inserted.
787You'll need to write something like C<m/\Quser\E\@\Qhost/>.
788
a0d0e21e
LW
789Patterns are subject to an additional level of interpretation as a
790regular expression. This is done as a second pass, after variables are
791interpolated, so that regular expressions may be incorporated into the
792pattern from the variables. If this is not what you want, use C<\Q> to
793interpolate a variable literally.
794
19799a22
GS
795Apart from the behavior described above, Perl does not expand
796multiple levels of interpolation. In particular, contrary to the
797expectations of shell programmers, back-quotes do I<NOT> interpolate
798within double quotes, nor do single quotes impede evaluation of
799variables when used within double quotes.
a0d0e21e 800
5f05dabc 801=head2 Regexp Quote-Like Operators
cb1a09d0 802
5f05dabc 803Here are the quote-like operators that apply to pattern
cb1a09d0
AD
804matching and related activities.
805
a0d0e21e
LW
806=over 8
807
808=item ?PATTERN?
809
810This is just like the C</pattern/> search, except that it matches only
811once between calls to the reset() operator. This is a useful
5f05dabc 812optimization when you want to see only the first occurrence of
a0d0e21e
LW
813something in each file of a set of files, for instance. Only C<??>
814patterns local to the current package are reset.
815
5a964f20
TC
816 while (<>) {
817 if (?^$?) {
818 # blank line between header and body
819 }
820 } continue {
821 reset if eof; # clear ?? status for next file
822 }
823
483b4840 824This usage is vaguely deprecated, which means it just might possibly
19799a22
GS
825be removed in some distant future version of Perl, perhaps somewhere
826around the year 2168.
a0d0e21e 827
fb73857a 828=item m/PATTERN/cgimosx
a0d0e21e 829
fb73857a 830=item /PATTERN/cgimosx
a0d0e21e 831
5a964f20 832Searches a string for a pattern match, and in scalar context returns
19799a22
GS
833true if it succeeds, false if it fails. If no string is specified
834via the C<=~> or C<!~> operator, the $_ string is searched. (The
835string specified with C<=~> need not be an lvalue--it may be the
836result of an expression evaluation, but remember the C<=~> binds
837rather tightly.) See also L<perlre>. See L<perllocale> for
838discussion of additional considerations that apply when C<use locale>
839is in effect.
a0d0e21e
LW
840
841Options are:
842
fb73857a 843 c Do not reset search position on a failed match when /g is in effect.
5f05dabc 844 g Match globally, i.e., find all occurrences.
a0d0e21e
LW
845 i Do case-insensitive pattern matching.
846 m Treat string as multiple lines.
5f05dabc 847 o Compile pattern only once.
a0d0e21e
LW
848 s Treat string as single line.
849 x Use extended regular expressions.
850
851If "/" is the delimiter then the initial C<m> is optional. With the C<m>
01ae956f 852you can use any pair of non-alphanumeric, non-whitespace characters
19799a22
GS
853as delimiters. This is particularly useful for matching path names
854that contain "/", to avoid LTS (leaning toothpick syndrome). If "?" is
7bac28a0 855the delimiter, then the match-only-once rule of C<?PATTERN?> applies.
19799a22 856If "'" is the delimiter, no interpolation is performed on the PATTERN.
a0d0e21e
LW
857
858PATTERN may contain variables, which will be interpolated (and the
f70b4f9c 859pattern recompiled) every time the pattern search is evaluated, except
1f247705
GS
860for when the delimiter is a single quote. (Note that C<$(>, C<$)>, and
861C<$|> are not interpolated because they look like end-of-string tests.)
f70b4f9c
AB
862If you want such a pattern to be compiled only once, add a C</o> after
863the trailing delimiter. This avoids expensive run-time recompilations,
864and is useful when the value you are interpolating won't change over
865the life of the script. However, mentioning C</o> constitutes a promise
866that you won't change the variables in the pattern. If you change them,
13a2d996 867Perl won't even notice. See also L<"qr/STRING/imosx">.
a0d0e21e 868
5a964f20 869If the PATTERN evaluates to the empty string, the last
d65afb4b
HS
870I<successfully> matched regular expression is used instead. In this
871case, only the C<g> and C<c> flags on the empty pattern is honoured -
872the other flags are taken from the original pattern. If no match has
873previously succeeded, this will (silently) act instead as a genuine
874empty pattern (which will always match).
a0d0e21e 875
c963b151
BD
876Note that it's possible to confuse Perl into thinking C<//> (the empty
877regex) is really C<//> (the defined-or operator). Perl is usually pretty
878good about this, but some pathological cases might trigger this, such as
879C<$a///> (is that C<($a) / (//)> or C<$a // />?) and C<print $fh //>
880(C<print $fh(//> or C<print($fh //>?). In all of these examples, Perl
881will assume you meant defined-or. If you meant the empty regex, just
882use parentheses or spaces to disambiguate, or even prefix the empty
883regex with an C<m> (so C<//> becomes C<m//>).
884
19799a22 885If the C</g> option is not used, C<m//> in list context returns a
a0d0e21e 886list consisting of the subexpressions matched by the parentheses in the
f7e33566
GS
887pattern, i.e., (C<$1>, C<$2>, C<$3>...). (Note that here C<$1> etc. are
888also set, and that this differs from Perl 4's behavior.) When there are
889no parentheses in the pattern, the return value is the list C<(1)> for
890success. With or without parentheses, an empty list is returned upon
891failure.
a0d0e21e
LW
892
893Examples:
894
895 open(TTY, '/dev/tty');
896 <TTY> =~ /^y/i && foo(); # do foo if desired
897
898 if (/Version: *([0-9.]*)/) { $version = $1; }
899
900 next if m#^/usr/spool/uucp#;
901
902 # poor man's grep
903 $arg = shift;
904 while (<>) {
905 print if /$arg/o; # compile only once
906 }
907
908 if (($F1, $F2, $Etc) = ($foo =~ /^(\S+)\s+(\S+)\s*(.*)/))
909
910This last example splits $foo into the first two words and the
5f05dabc 911remainder of the line, and assigns those three fields to $F1, $F2, and
912$Etc. The conditional is true if any variables were assigned, i.e., if
a0d0e21e
LW
913the pattern matched.
914
19799a22
GS
915The C</g> modifier specifies global pattern matching--that is,
916matching as many times as possible within the string. How it behaves
917depends on the context. In list context, it returns a list of the
918substrings matched by any capturing parentheses in the regular
919expression. If there are no parentheses, it returns a list of all
920the matched strings, as if there were parentheses around the whole
921pattern.
a0d0e21e 922
7e86de3e 923In scalar context, each execution of C<m//g> finds the next match,
19799a22 924returning true if it matches, and false if there is no further match.
7e86de3e
MG
925The position after the last match can be read or set using the pos()
926function; see L<perlfunc/pos>. A failed match normally resets the
927search position to the beginning of the string, but you can avoid that
928by adding the C</c> modifier (e.g. C<m//gc>). Modifying the target
929string also resets the search position.
c90c0ff4 930
931You can intermix C<m//g> matches with C<m/\G.../g>, where C<\G> is a
932zero-width assertion that matches the exact position where the previous
5d43e42d
DC
933C<m//g>, if any, left off. Without the C</g> modifier, the C<\G> assertion
934still anchors at pos(), but the match is of course only attempted once.
935Using C<\G> without C</g> on a target string that has not previously had a
936C</g> match applied to it is the same as using the C<\A> assertion to match
fe4b3f22
RGS
937the beginning of the string. Note also that, currently, C<\G> is only
938properly supported when anchored at the very beginning of the pattern.
c90c0ff4 939
940Examples:
a0d0e21e
LW
941
942 # list context
943 ($one,$five,$fifteen) = (`uptime` =~ /(\d+\.\d+)/g);
944
945 # scalar context
5d43e42d 946 $/ = "";
19799a22
GS
947 while (defined($paragraph = <>)) {
948 while ($paragraph =~ /[a-z]['")]*[.!?]+['")]*\s/g) {
949 $sentences++;
a0d0e21e
LW
950 }
951 }
952 print "$sentences\n";
953
c90c0ff4 954 # using m//gc with \G
137443ea 955 $_ = "ppooqppqq";
44a8e56a 956 while ($i++ < 2) {
957 print "1: '";
c90c0ff4 958 print $1 while /(o)/gc; print "', pos=", pos, "\n";
44a8e56a 959 print "2: '";
c90c0ff4 960 print $1 if /\G(q)/gc; print "', pos=", pos, "\n";
44a8e56a 961 print "3: '";
c90c0ff4 962 print $1 while /(p)/gc; print "', pos=", pos, "\n";
44a8e56a 963 }
5d43e42d 964 print "Final: '$1', pos=",pos,"\n" if /\G(.)/;
44a8e56a 965
966The last example should print:
967
968 1: 'oo', pos=4
137443ea 969 2: 'q', pos=5
44a8e56a 970 3: 'pp', pos=7
971 1: '', pos=7
137443ea 972 2: 'q', pos=8
973 3: '', pos=8
5d43e42d
DC
974 Final: 'q', pos=8
975
976Notice that the final match matched C<q> instead of C<p>, which a match
977without the C<\G> anchor would have done. Also note that the final match
978did not update C<pos> -- C<pos> is only updated on a C</g> match. If the
979final match did indeed match C<p>, it's a good bet that you're running an
980older (pre-5.6.0) Perl.
44a8e56a 981
c90c0ff4 982A useful idiom for C<lex>-like scanners is C</\G.../gc>. You can
e7ea3e70 983combine several regexps like this to process a string part-by-part,
c90c0ff4 984doing different actions depending on which regexp matched. Each
985regexp tries to match where the previous one leaves off.
e7ea3e70 986
3fe9a6f1 987 $_ = <<'EOL';
e7ea3e70 988 $url = new URI::URL "http://www/"; die if $url eq "xXx";
3fe9a6f1 989 EOL
990 LOOP:
e7ea3e70 991 {
c90c0ff4 992 print(" digits"), redo LOOP if /\G\d+\b[,.;]?\s*/gc;
993 print(" lowercase"), redo LOOP if /\G[a-z]+\b[,.;]?\s*/gc;
994 print(" UPPERCASE"), redo LOOP if /\G[A-Z]+\b[,.;]?\s*/gc;
995 print(" Capitalized"), redo LOOP if /\G[A-Z][a-z]+\b[,.;]?\s*/gc;
996 print(" MiXeD"), redo LOOP if /\G[A-Za-z]+\b[,.;]?\s*/gc;
997 print(" alphanumeric"), redo LOOP if /\G[A-Za-z0-9]+\b[,.;]?\s*/gc;
998 print(" line-noise"), redo LOOP if /\G[^A-Za-z0-9]+/gc;
e7ea3e70
IZ
999 print ". That's all!\n";
1000 }
1001
1002Here is the output (split into several lines):
1003
1004 line-noise lowercase line-noise lowercase UPPERCASE line-noise
1005 UPPERCASE line-noise lowercase line-noise lowercase line-noise
1006 lowercase lowercase line-noise lowercase lowercase line-noise
1007 MiXeD line-noise. That's all!
44a8e56a 1008
a0d0e21e
LW
1009=item q/STRING/
1010
1011=item C<'STRING'>
1012
19799a22 1013A single-quoted, literal string. A backslash represents a backslash
68dc0745 1014unless followed by the delimiter or another backslash, in which case
1015the delimiter or backslash is interpolated.
a0d0e21e
LW
1016
1017 $foo = q!I said, "You said, 'She said it.'"!;
1018 $bar = q('This is it.');
68dc0745 1019 $baz = '\n'; # a two-character string
a0d0e21e
LW
1020
1021=item qq/STRING/
1022
1023=item "STRING"
1024
1025A double-quoted, interpolated string.
1026
1027 $_ .= qq
1028 (*** The previous line contains the naughty word "$1".\n)
19799a22 1029 if /\b(tcl|java|python)\b/i; # :-)
68dc0745 1030 $baz = "\n"; # a one-character string
a0d0e21e 1031
eec2d3df
GS
1032=item qr/STRING/imosx
1033
322edccd 1034This operator quotes (and possibly compiles) its I<STRING> as a regular
19799a22
GS
1035expression. I<STRING> is interpolated the same way as I<PATTERN>
1036in C<m/PATTERN/>. If "'" is used as the delimiter, no interpolation
1037is done. Returns a Perl value which may be used instead of the
1038corresponding C</STRING/imosx> expression.
4b6a7270
IZ
1039
1040For example,
1041
1042 $rex = qr/my.STRING/is;
1043 s/$rex/foo/;
1044
1045is equivalent to
1046
1047 s/my.STRING/foo/is;
1048
1049The result may be used as a subpattern in a match:
eec2d3df
GS
1050
1051 $re = qr/$pattern/;
0a92e3a8
GS
1052 $string =~ /foo${re}bar/; # can be interpolated in other patterns
1053 $string =~ $re; # or used standalone
4b6a7270
IZ
1054 $string =~ /$re/; # or this way
1055
1056Since Perl may compile the pattern at the moment of execution of qr()
19799a22 1057operator, using qr() may have speed advantages in some situations,
4b6a7270
IZ
1058notably if the result of qr() is used standalone:
1059
1060 sub match {
1061 my $patterns = shift;
1062 my @compiled = map qr/$_/i, @$patterns;
1063 grep {
1064 my $success = 0;
a7665c5e 1065 foreach my $pat (@compiled) {
4b6a7270
IZ
1066 $success = 1, last if /$pat/;
1067 }
1068 $success;
1069 } @_;
1070 }
1071
19799a22
GS
1072Precompilation of the pattern into an internal representation at
1073the moment of qr() avoids a need to recompile the pattern every
1074time a match C</$pat/> is attempted. (Perl has many other internal
1075optimizations, but none would be triggered in the above example if
1076we did not use qr() operator.)
eec2d3df
GS
1077
1078Options are:
1079
1080 i Do case-insensitive pattern matching.
1081 m Treat string as multiple lines.
1082 o Compile pattern only once.
1083 s Treat string as single line.
1084 x Use extended regular expressions.
1085
0a92e3a8
GS
1086See L<perlre> for additional information on valid syntax for STRING, and
1087for a detailed look at the semantics of regular expressions.
1088
a0d0e21e
LW
1089=item qx/STRING/
1090
1091=item `STRING`
1092
43dd4d21
JH
1093A string which is (possibly) interpolated and then executed as a
1094system command with C</bin/sh> or its equivalent. Shell wildcards,
1095pipes, and redirections will be honored. The collected standard
1096output of the command is returned; standard error is unaffected. In
1097scalar context, it comes back as a single (potentially multi-line)
1098string, or undef if the command failed. In list context, returns a
1099list of lines (however you've defined lines with $/ or
1100$INPUT_RECORD_SEPARATOR), or an empty list if the command failed.
5a964f20
TC
1101
1102Because backticks do not affect standard error, use shell file descriptor
1103syntax (assuming the shell supports this) if you care to address this.
1104To capture a command's STDERR and STDOUT together:
a0d0e21e 1105
5a964f20
TC
1106 $output = `cmd 2>&1`;
1107
1108To capture a command's STDOUT but discard its STDERR:
1109
1110 $output = `cmd 2>/dev/null`;
1111
1112To capture a command's STDERR but discard its STDOUT (ordering is
1113important here):
1114
1115 $output = `cmd 2>&1 1>/dev/null`;
1116
1117To exchange a command's STDOUT and STDERR in order to capture the STDERR
1118but leave its STDOUT to come out the old STDERR:
1119
1120 $output = `cmd 3>&1 1>&2 2>&3 3>&-`;
1121
1122To read both a command's STDOUT and its STDERR separately, it's easiest
1123and safest to redirect them separately to files, and then read from those
1124files when the program is done:
1125
1126 system("program args 1>/tmp/program.stdout 2>/tmp/program.stderr");
1127
1128Using single-quote as a delimiter protects the command from Perl's
1129double-quote interpolation, passing it on to the shell instead:
1130
1131 $perl_info = qx(ps $$); # that's Perl's $$
1132 $shell_info = qx'ps $$'; # that's the new shell's $$
1133
19799a22 1134How that string gets evaluated is entirely subject to the command
5a964f20
TC
1135interpreter on your system. On most platforms, you will have to protect
1136shell metacharacters if you want them treated literally. This is in
1137practice difficult to do, as it's unclear how to escape which characters.
1138See L<perlsec> for a clean and safe example of a manual fork() and exec()
1139to emulate backticks safely.
a0d0e21e 1140
bb32b41a
GS
1141On some platforms (notably DOS-like ones), the shell may not be
1142capable of dealing with multiline commands, so putting newlines in
1143the string may not get you what you want. You may be able to evaluate
1144multiple commands in a single line by separating them with the command
1145separator character, if your shell supports that (e.g. C<;> on many Unix
1146shells; C<&> on the Windows NT C<cmd> shell).
1147
0f897271
GS
1148Beginning with v5.6.0, Perl will attempt to flush all files opened for
1149output before starting the child process, but this may not be supported
1150on some platforms (see L<perlport>). To be safe, you may need to set
1151C<$|> ($AUTOFLUSH in English) or call the C<autoflush()> method of
1152C<IO::Handle> on any open handles.
1153
bb32b41a
GS
1154Beware that some command shells may place restrictions on the length
1155of the command line. You must ensure your strings don't exceed this
1156limit after any necessary interpolations. See the platform-specific
1157release notes for more details about your particular environment.
1158
5a964f20
TC
1159Using this operator can lead to programs that are difficult to port,
1160because the shell commands called vary between systems, and may in
1161fact not be present at all. As one example, the C<type> command under
1162the POSIX shell is very different from the C<type> command under DOS.
1163That doesn't mean you should go out of your way to avoid backticks
1164when they're the right way to get something done. Perl was made to be
1165a glue language, and one of the things it glues together is commands.
1166Just understand what you're getting yourself into.
bb32b41a 1167
dc848c6f 1168See L<"I/O Operators"> for more discussion.
a0d0e21e 1169
945c54fd
JH
1170=item qw/STRING/
1171
1172Evaluates to a list of the words extracted out of STRING, using embedded
1173whitespace as the word delimiters. It can be understood as being roughly
1174equivalent to:
1175
1176 split(' ', q/STRING/);
1177
1178the difference being that it generates a real list at compile time. So
1179this expression:
1180
1181 qw(foo bar baz)
1182
1183is semantically equivalent to the list:
1184
1185 'foo', 'bar', 'baz'
1186
1187Some frequently seen examples:
1188
1189 use POSIX qw( setlocale localeconv )
1190 @EXPORT = qw( foo bar baz );
1191
1192A common mistake is to try to separate the words with comma or to
1193put comments into a multi-line C<qw>-string. For this reason, the
1194C<use warnings> pragma and the B<-w> switch (that is, the C<$^W> variable)
1195produces warnings if the STRING contains the "," or the "#" character.
1196
a0d0e21e
LW
1197=item s/PATTERN/REPLACEMENT/egimosx
1198
1199Searches a string for a pattern, and if found, replaces that pattern
1200with the replacement text and returns the number of substitutions
e37d713d 1201made. Otherwise it returns false (specifically, the empty string).
a0d0e21e
LW
1202
1203If no string is specified via the C<=~> or C<!~> operator, the C<$_>
1204variable is searched and modified. (The string specified with C<=~> must
5a964f20 1205be scalar variable, an array element, a hash element, or an assignment
5f05dabc 1206to one of those, i.e., an lvalue.)
a0d0e21e 1207
19799a22 1208If the delimiter chosen is a single quote, no interpolation is
a0d0e21e
LW
1209done on either the PATTERN or the REPLACEMENT. Otherwise, if the
1210PATTERN contains a $ that looks like a variable rather than an
1211end-of-string test, the variable will be interpolated into the pattern
5f05dabc 1212at run-time. If you want the pattern compiled only once the first time
a0d0e21e 1213the variable is interpolated, use the C</o> option. If the pattern
5a964f20 1214evaluates to the empty string, the last successfully executed regular
a0d0e21e 1215expression is used instead. See L<perlre> for further explanation on these.
5a964f20 1216See L<perllocale> for discussion of additional considerations that apply
a034a98d 1217when C<use locale> is in effect.
a0d0e21e
LW
1218
1219Options are:
1220
1221 e Evaluate the right side as an expression.
5f05dabc 1222 g Replace globally, i.e., all occurrences.
a0d0e21e
LW
1223 i Do case-insensitive pattern matching.
1224 m Treat string as multiple lines.
5f05dabc 1225 o Compile pattern only once.
a0d0e21e
LW
1226 s Treat string as single line.
1227 x Use extended regular expressions.
1228
1229Any non-alphanumeric, non-whitespace delimiter may replace the
1230slashes. If single quotes are used, no interpretation is done on the
e37d713d 1231replacement string (the C</e> modifier overrides this, however). Unlike
54310121 1232Perl 4, Perl 5 treats backticks as normal delimiters; the replacement
e37d713d 1233text is not evaluated as a command. If the
a0d0e21e 1234PATTERN is delimited by bracketing quotes, the REPLACEMENT has its own
5f05dabc 1235pair of quotes, which may or may not be bracketing quotes, e.g.,
35f2feb0 1236C<s(foo)(bar)> or C<< s<foo>/bar/ >>. A C</e> will cause the
cec88af6
GS
1237replacement portion to be treated as a full-fledged Perl expression
1238and evaluated right then and there. It is, however, syntax checked at
1239compile-time. A second C<e> modifier will cause the replacement portion
1240to be C<eval>ed before being run as a Perl expression.
a0d0e21e
LW
1241
1242Examples:
1243
1244 s/\bgreen\b/mauve/g; # don't change wintergreen
1245
1246 $path =~ s|/usr/bin|/usr/local/bin|;
1247
1248 s/Login: $foo/Login: $bar/; # run-time pattern
1249
5a964f20 1250 ($foo = $bar) =~ s/this/that/; # copy first, then change
a0d0e21e 1251
5a964f20 1252 $count = ($paragraph =~ s/Mister\b/Mr./g); # get change-count
a0d0e21e
LW
1253
1254 $_ = 'abc123xyz';
1255 s/\d+/$&*2/e; # yields 'abc246xyz'
1256 s/\d+/sprintf("%5d",$&)/e; # yields 'abc 246xyz'
1257 s/\w/$& x 2/eg; # yields 'aabbcc 224466xxyyzz'
1258
1259 s/%(.)/$percent{$1}/g; # change percent escapes; no /e
1260 s/%(.)/$percent{$1} || $&/ge; # expr now, so /e
1261 s/^=(\w+)/&pod($1)/ge; # use function call
1262
5a964f20
TC
1263 # expand variables in $_, but dynamics only, using
1264 # symbolic dereferencing
1265 s/\$(\w+)/${$1}/g;
1266
cec88af6
GS
1267 # Add one to the value of any numbers in the string
1268 s/(\d+)/1 + $1/eg;
1269
1270 # This will expand any embedded scalar variable
1271 # (including lexicals) in $_ : First $1 is interpolated
1272 # to the variable name, and then evaluated
a0d0e21e
LW
1273 s/(\$\w+)/$1/eeg;
1274
5a964f20 1275 # Delete (most) C comments.
a0d0e21e 1276 $program =~ s {
4633a7c4
LW
1277 /\* # Match the opening delimiter.
1278 .*? # Match a minimal number of characters.
1279 \*/ # Match the closing delimiter.
a0d0e21e
LW
1280 } []gsx;
1281
5a964f20
TC
1282 s/^\s*(.*?)\s*$/$1/; # trim white space in $_, expensively
1283
1284 for ($variable) { # trim white space in $variable, cheap
1285 s/^\s+//;
1286 s/\s+$//;
1287 }
a0d0e21e
LW
1288
1289 s/([^ ]*) *([^ ]*)/$2 $1/; # reverse 1st two fields
1290
54310121 1291Note the use of $ instead of \ in the last example. Unlike
35f2feb0
GS
1292B<sed>, we use the \<I<digit>> form in only the left hand side.
1293Anywhere else it's $<I<digit>>.
a0d0e21e 1294
5f05dabc 1295Occasionally, you can't use just a C</g> to get all the changes
19799a22 1296to occur that you might want. Here are two common cases:
a0d0e21e
LW
1297
1298 # put commas in the right places in an integer
19799a22 1299 1 while s/(\d)(\d\d\d)(?!\d)/$1,$2/g;
a0d0e21e
LW
1300
1301 # expand tabs to 8-column spacing
1302 1 while s/\t+/' ' x (length($&)*8 - length($`)%8)/e;
1303
6940069f 1304=item tr/SEARCHLIST/REPLACEMENTLIST/cds
a0d0e21e 1305
6940069f 1306=item y/SEARCHLIST/REPLACEMENTLIST/cds
a0d0e21e 1307
2c268ad5 1308Transliterates all occurrences of the characters found in the search list
a0d0e21e
LW
1309with the corresponding character in the replacement list. It returns
1310the number of characters replaced or deleted. If no string is
2c268ad5 1311specified via the =~ or !~ operator, the $_ string is transliterated. (The
54310121 1312string specified with =~ must be a scalar variable, an array element, a
1313hash element, or an assignment to one of those, i.e., an lvalue.)
8ada0baa 1314
2c268ad5
TP
1315A character range may be specified with a hyphen, so C<tr/A-J/0-9/>
1316does the same replacement as C<tr/ACEGIBDFHJ/0246813579/>.
54310121 1317For B<sed> devotees, C<y> is provided as a synonym for C<tr>. If the
1318SEARCHLIST is delimited by bracketing quotes, the REPLACEMENTLIST has
1319its own pair of quotes, which may or may not be bracketing quotes,
2c268ad5 1320e.g., C<tr[A-Z][a-z]> or C<tr(+\-*/)/ABCD/>.
a0d0e21e 1321
cc255d5f
JH
1322Note that C<tr> does B<not> do regular expression character classes
1323such as C<\d> or C<[:lower:]>. The <tr> operator is not equivalent to
1324the tr(1) utility. If you want to map strings between lower/upper
1325cases, see L<perlfunc/lc> and L<perlfunc/uc>, and in general consider
1326using the C<s> operator if you need regular expressions.
1327
8ada0baa
JH
1328Note also that the whole range idea is rather unportable between
1329character sets--and even within character sets they may cause results
1330you probably didn't expect. A sound principle is to use only ranges
1331that begin from and end at either alphabets of equal case (a-e, A-E),
1332or digits (0-4). Anything else is unsafe. If in doubt, spell out the
1333character sets in full.
1334
a0d0e21e
LW
1335Options:
1336
1337 c Complement the SEARCHLIST.
1338 d Delete found but unreplaced characters.
1339 s Squash duplicate replaced characters.
1340
19799a22
GS
1341If the C</c> modifier is specified, the SEARCHLIST character set
1342is complemented. If the C</d> modifier is specified, any characters
1343specified by SEARCHLIST not found in REPLACEMENTLIST are deleted.
1344(Note that this is slightly more flexible than the behavior of some
1345B<tr> programs, which delete anything they find in the SEARCHLIST,
1346period.) If the C</s> modifier is specified, sequences of characters
1347that were transliterated to the same character are squashed down
1348to a single instance of the character.
a0d0e21e
LW
1349
1350If the C</d> modifier is used, the REPLACEMENTLIST is always interpreted
1351exactly as specified. Otherwise, if the REPLACEMENTLIST is shorter
1352than the SEARCHLIST, the final character is replicated till it is long
5a964f20 1353enough. If the REPLACEMENTLIST is empty, the SEARCHLIST is replicated.
a0d0e21e
LW
1354This latter is useful for counting characters in a class or for
1355squashing character sequences in a class.
1356
1357Examples:
1358
1359 $ARGV[1] =~ tr/A-Z/a-z/; # canonicalize to lower case
1360
1361 $cnt = tr/*/*/; # count the stars in $_
1362
1363 $cnt = $sky =~ tr/*/*/; # count the stars in $sky
1364
1365 $cnt = tr/0-9//; # count the digits in $_
1366
1367 tr/a-zA-Z//s; # bookkeeper -> bokeper
1368
1369 ($HOST = $host) =~ tr/a-z/A-Z/;
1370
1371 tr/a-zA-Z/ /cs; # change non-alphas to single space
1372
1373 tr [\200-\377]
1374 [\000-\177]; # delete 8th bit
1375
19799a22
GS
1376If multiple transliterations are given for a character, only the
1377first one is used:
748a9306
LW
1378
1379 tr/AAA/XYZ/
1380
2c268ad5 1381will transliterate any A to X.
748a9306 1382
19799a22 1383Because the transliteration table is built at compile time, neither
a0d0e21e 1384the SEARCHLIST nor the REPLACEMENTLIST are subjected to double quote
19799a22
GS
1385interpolation. That means that if you want to use variables, you
1386must use an eval():
a0d0e21e
LW
1387
1388 eval "tr/$oldlist/$newlist/";
1389 die $@ if $@;
1390
1391 eval "tr/$oldlist/$newlist/, 1" or die $@;
1392
7e3b091d
DA
1393=item <<EOF
1394
1395A line-oriented form of quoting is based on the shell "here-document"
1396syntax. Following a C<< << >> you specify a string to terminate
1397the quoted material, and all lines following the current line down to
1398the terminating string are the value of the item. The terminating
1399string may be either an identifier (a word), or some quoted text. If
1400quoted, the type of quotes you use determines the treatment of the
1401text, just as in regular quoting. An unquoted identifier works like
1402double quotes. There must be no space between the C<< << >> and
1403the identifier, unless the identifier is quoted. (If you put a space it
1404will be treated as a null identifier, which is valid, and matches the first
1405empty line.) The terminating string must appear by itself (unquoted and
1406with no surrounding whitespace) on the terminating line.
1407
1408 print <<EOF;
1409 The price is $Price.
1410 EOF
1411
1412 print << "EOF"; # same as above
1413 The price is $Price.
1414 EOF
1415
1416 print << `EOC`; # execute commands
1417 echo hi there
1418 echo lo there
1419 EOC
1420
1421 print <<"foo", <<"bar"; # you can stack them
1422 I said foo.
1423 foo
1424 I said bar.
1425 bar
1426
1427 myfunc(<< "THIS", 23, <<'THAT');
1428 Here's a line
1429 or two.
1430 THIS
1431 and here's another.
1432 THAT
1433
1434Just don't forget that you have to put a semicolon on the end
1435to finish the statement, as Perl doesn't know you're not going to
1436try to do this:
1437
1438 print <<ABC
1439 179231
1440 ABC
1441 + 20;
1442
1443If you want your here-docs to be indented with the
1444rest of the code, you'll need to remove leading whitespace
1445from each line manually:
1446
1447 ($quote = <<'FINIS') =~ s/^\s+//gm;
1448 The Road goes ever on and on,
1449 down from the door where it began.
1450 FINIS
1451
1452If you use a here-doc within a delimited construct, such as in C<s///eg>,
1453the quoted material must come on the lines following the final delimiter.
1454So instead of
1455
1456 s/this/<<E . 'that'
1457 the other
1458 E
1459 . 'more '/eg;
1460
1461you have to write
1462
1463 s/this/<<E . 'that'
1464 . 'more '/eg;
1465 the other
1466 E
1467
1468If the terminating identifier is on the last line of the program, you
1469must be sure there is a newline after it; otherwise, Perl will give the
1470warning B<Can't find string terminator "END" anywhere before EOF...>.
1471
1472Additionally, the quoting rules for the identifier are not related to
1473Perl's quoting rules -- C<q()>, C<qq()>, and the like are not supported
1474in place of C<''> and C<"">, and the only interpolation is for backslashing
1475the quoting character:
1476
1477 print << "abc\"def";
1478 testing...
1479 abc"def
1480
1481Finally, quoted strings cannot span multiple lines. The general rule is
1482that the identifier must be a string literal. Stick with that, and you
1483should be safe.
1484
a0d0e21e
LW
1485=back
1486
75e14d17
IZ
1487=head2 Gory details of parsing quoted constructs
1488
19799a22
GS
1489When presented with something that might have several different
1490interpretations, Perl uses the B<DWIM> (that's "Do What I Mean")
1491principle to pick the most probable interpretation. This strategy
1492is so successful that Perl programmers often do not suspect the
1493ambivalence of what they write. But from time to time, Perl's
1494notions differ substantially from what the author honestly meant.
1495
1496This section hopes to clarify how Perl handles quoted constructs.
1497Although the most common reason to learn this is to unravel labyrinthine
1498regular expressions, because the initial steps of parsing are the
1499same for all quoting operators, they are all discussed together.
1500
1501The most important Perl parsing rule is the first one discussed
1502below: when processing a quoted construct, Perl first finds the end
1503of that construct, then interprets its contents. If you understand
1504this rule, you may skip the rest of this section on the first
1505reading. The other rules are likely to contradict the user's
1506expectations much less frequently than this first one.
1507
1508Some passes discussed below are performed concurrently, but because
1509their results are the same, we consider them individually. For different
1510quoting constructs, Perl performs different numbers of passes, from
1511one to five, but these passes are always performed in the same order.
75e14d17 1512
13a2d996 1513=over 4
75e14d17
IZ
1514
1515=item Finding the end
1516
19799a22
GS
1517The first pass is finding the end of the quoted construct, whether
1518it be a multicharacter delimiter C<"\nEOF\n"> in the C<<<EOF>
1519construct, a C</> that terminates a C<qq//> construct, a C<]> which
35f2feb0
GS
1520terminates C<qq[]> construct, or a C<< > >> which terminates a
1521fileglob started with C<< < >>.
75e14d17 1522
19799a22
GS
1523When searching for single-character non-pairing delimiters, such
1524as C</>, combinations of C<\\> and C<\/> are skipped. However,
1525when searching for single-character pairing delimiter like C<[>,
1526combinations of C<\\>, C<\]>, and C<\[> are all skipped, and nested
1527C<[>, C<]> are skipped as well. When searching for multicharacter
1528delimiters, nothing is skipped.
75e14d17 1529
19799a22
GS
1530For constructs with three-part delimiters (C<s///>, C<y///>, and
1531C<tr///>), the search is repeated once more.
75e14d17 1532
19799a22
GS
1533During this search no attention is paid to the semantics of the construct.
1534Thus:
75e14d17
IZ
1535
1536 "$hash{"$foo/$bar"}"
1537
2a94b7ce 1538or:
75e14d17
IZ
1539
1540 m/
2a94b7ce 1541 bar # NOT a comment, this slash / terminated m//!
75e14d17
IZ
1542 /x
1543
19799a22
GS
1544do not form legal quoted expressions. The quoted part ends on the
1545first C<"> and C</>, and the rest happens to be a syntax error.
1546Because the slash that terminated C<m//> was followed by a C<SPACE>,
1547the example above is not C<m//x>, but rather C<m//> with no C</x>
1548modifier. So the embedded C<#> is interpreted as a literal C<#>.
75e14d17
IZ
1549
1550=item Removal of backslashes before delimiters
1551
19799a22
GS
1552During the second pass, text between the starting and ending
1553delimiters is copied to a safe location, and the C<\> is removed
1554from combinations consisting of C<\> and delimiter--or delimiters,
1555meaning both starting and ending delimiters will should these differ.
1556This removal does not happen for multi-character delimiters.
1557Note that the combination C<\\> is left intact, just as it was.
75e14d17 1558
19799a22
GS
1559Starting from this step no information about the delimiters is
1560used in parsing.
75e14d17
IZ
1561
1562=item Interpolation
1563
19799a22
GS
1564The next step is interpolation in the text obtained, which is now
1565delimiter-independent. There are four different cases.
75e14d17 1566
13a2d996 1567=over 4
75e14d17
IZ
1568
1569=item C<<<'EOF'>, C<m''>, C<s'''>, C<tr///>, C<y///>
1570
1571No interpolation is performed.
1572
1573=item C<''>, C<q//>
1574
1575The only interpolation is removal of C<\> from pairs C<\\>.
1576
35f2feb0 1577=item C<"">, C<``>, C<qq//>, C<qx//>, C<< <file*glob> >>
75e14d17 1578
19799a22
GS
1579C<\Q>, C<\U>, C<\u>, C<\L>, C<\l> (possibly paired with C<\E>) are
1580converted to corresponding Perl constructs. Thus, C<"$foo\Qbaz$bar">
1581is converted to C<$foo . (quotemeta("baz" . $bar))> internally.
1582The other combinations are replaced with appropriate expansions.
2a94b7ce 1583
19799a22
GS
1584Let it be stressed that I<whatever falls between C<\Q> and C<\E>>
1585is interpolated in the usual way. Something like C<"\Q\\E"> has
1586no C<\E> inside. instead, it has C<\Q>, C<\\>, and C<E>, so the
1587result is the same as for C<"\\\\E">. As a general rule, backslashes
1588between C<\Q> and C<\E> may lead to counterintuitive results. So,
1589C<"\Q\t\E"> is converted to C<quotemeta("\t")>, which is the same
1590as C<"\\\t"> (since TAB is not alphanumeric). Note also that:
2a94b7ce
IZ
1591
1592 $str = '\t';
1593 return "\Q$str";
1594
1595may be closer to the conjectural I<intention> of the writer of C<"\Q\t\E">.
1596
19799a22 1597Interpolated scalars and arrays are converted internally to the C<join> and
92d29cee 1598C<.> catenation operations. Thus, C<"$foo XXX '@arr'"> becomes:
75e14d17 1599
19799a22 1600 $foo . " XXX '" . (join $", @arr) . "'";
75e14d17 1601
19799a22 1602All operations above are performed simultaneously, left to right.
75e14d17 1603
19799a22
GS
1604Because the result of C<"\Q STRING \E"> has all metacharacters
1605quoted, there is no way to insert a literal C<$> or C<@> inside a
1606C<\Q\E> pair. If protected by C<\>, C<$> will be quoted to became
1607C<"\\\$">; if not, it is interpreted as the start of an interpolated
1608scalar.
75e14d17 1609
19799a22
GS
1610Note also that the interpolation code needs to make a decision on
1611where the interpolated scalar ends. For instance, whether
35f2feb0 1612C<< "a $b -> {c}" >> really means:
75e14d17
IZ
1613
1614 "a " . $b . " -> {c}";
1615
2a94b7ce 1616or:
75e14d17
IZ
1617
1618 "a " . $b -> {c};
1619
19799a22
GS
1620Most of the time, the longest possible text that does not include
1621spaces between components and which contains matching braces or
1622brackets. because the outcome may be determined by voting based
1623on heuristic estimators, the result is not strictly predictable.
1624Fortunately, it's usually correct for ambiguous cases.
75e14d17
IZ
1625
1626=item C<?RE?>, C</RE/>, C<m/RE/>, C<s/RE/foo/>,
1627
19799a22
GS
1628Processing of C<\Q>, C<\U>, C<\u>, C<\L>, C<\l>, and interpolation
1629happens (almost) as with C<qq//> constructs, but the substitution
1630of C<\> followed by RE-special chars (including C<\>) is not
1631performed. Moreover, inside C<(?{BLOCK})>, C<(?# comment )>, and
1632a C<#>-comment in a C<//x>-regular expression, no processing is
1633performed whatsoever. This is the first step at which the presence
1634of the C<//x> modifier is relevant.
1635
1636Interpolation has several quirks: C<$|>, C<$(>, and C<$)> are not
1637interpolated, and constructs C<$var[SOMETHING]> are voted (by several
1638different estimators) to be either an array element or C<$var>
1639followed by an RE alternative. This is where the notation
1640C<${arr[$bar]}> comes handy: C</${arr[0-9]}/> is interpreted as
1641array element C<-9>, not as a regular expression from the variable
1642C<$arr> followed by a digit, which would be the interpretation of
1643C</$arr[0-9]/>. Since voting among different estimators may occur,
1644the result is not predictable.
1645
1646It is at this step that C<\1> is begrudgingly converted to C<$1> in
1647the replacement text of C<s///> to correct the incorrigible
1648I<sed> hackers who haven't picked up the saner idiom yet. A warning
9f1b1f2d
GS
1649is emitted if the C<use warnings> pragma or the B<-w> command-line flag
1650(that is, the C<$^W> variable) was set.
19799a22
GS
1651
1652The lack of processing of C<\\> creates specific restrictions on
1653the post-processed text. If the delimiter is C</>, one cannot get
1654the combination C<\/> into the result of this step. C</> will
1655finish the regular expression, C<\/> will be stripped to C</> on
1656the previous step, and C<\\/> will be left as is. Because C</> is
1657equivalent to C<\/> inside a regular expression, this does not
1658matter unless the delimiter happens to be character special to the
1659RE engine, such as in C<s*foo*bar*>, C<m[foo]>, or C<?foo?>; or an
1660alphanumeric char, as in:
2a94b7ce
IZ
1661
1662 m m ^ a \s* b mmx;
1663
19799a22 1664In the RE above, which is intentionally obfuscated for illustration, the
2a94b7ce 1665delimiter is C<m>, the modifier is C<mx>, and after backslash-removal the
19799a22
GS
1666RE is the same as for C<m/ ^ a s* b /mx>). There's more than one
1667reason you're encouraged to restrict your delimiters to non-alphanumeric,
1668non-whitespace choices.
75e14d17
IZ
1669
1670=back
1671
19799a22 1672This step is the last one for all constructs except regular expressions,
75e14d17
IZ
1673which are processed further.
1674
1675=item Interpolation of regular expressions
1676
19799a22
GS
1677Previous steps were performed during the compilation of Perl code,
1678but this one happens at run time--although it may be optimized to
1679be calculated at compile time if appropriate. After preprocessing
1680described above, and possibly after evaluation if catenation,
1681joining, casing translation, or metaquoting are involved, the
1682resulting I<string> is passed to the RE engine for compilation.
1683
1684Whatever happens in the RE engine might be better discussed in L<perlre>,
1685but for the sake of continuity, we shall do so here.
1686
1687This is another step where the presence of the C<//x> modifier is
1688relevant. The RE engine scans the string from left to right and
1689converts it to a finite automaton.
1690
1691Backslashed characters are either replaced with corresponding
1692literal strings (as with C<\{>), or else they generate special nodes
1693in the finite automaton (as with C<\b>). Characters special to the
1694RE engine (such as C<|>) generate corresponding nodes or groups of
1695nodes. C<(?#...)> comments are ignored. All the rest is either
1696converted to literal strings to match, or else is ignored (as is
1697whitespace and C<#>-style comments if C<//x> is present).
1698
1699Parsing of the bracketed character class construct, C<[...]>, is
1700rather different than the rule used for the rest of the pattern.
1701The terminator of this construct is found using the same rules as
1702for finding the terminator of a C<{}>-delimited construct, the only
1703exception being that C<]> immediately following C<[> is treated as
1704though preceded by a backslash. Similarly, the terminator of
1705C<(?{...})> is found using the same rules as for finding the
1706terminator of a C<{}>-delimited construct.
1707
1708It is possible to inspect both the string given to RE engine and the
1709resulting finite automaton. See the arguments C<debug>/C<debugcolor>
1710in the C<use L<re>> pragma, as well as Perl's B<-Dr> command-line
4a4eefd0 1711switch documented in L<perlrun/"Command Switches">.
75e14d17
IZ
1712
1713=item Optimization of regular expressions
1714
7522fed5 1715This step is listed for completeness only. Since it does not change
75e14d17 1716semantics, details of this step are not documented and are subject
19799a22
GS
1717to change without notice. This step is performed over the finite
1718automaton that was generated during the previous pass.
2a94b7ce 1719
19799a22
GS
1720It is at this stage that C<split()> silently optimizes C</^/> to
1721mean C</^/m>.
75e14d17
IZ
1722
1723=back
1724
a0d0e21e
LW
1725=head2 I/O Operators
1726
54310121 1727There are several I/O operators you should know about.
fbad3eb5 1728
7b8d334a 1729A string enclosed by backticks (grave accents) first undergoes
19799a22
GS
1730double-quote interpolation. It is then interpreted as an external
1731command, and the output of that command is the value of the
e9c56f9b
JH
1732backtick string, like in a shell. In scalar context, a single string
1733consisting of all output is returned. In list context, a list of
1734values is returned, one per line of output. (You can set C<$/> to use
1735a different line terminator.) The command is executed each time the
1736pseudo-literal is evaluated. The status value of the command is
1737returned in C<$?> (see L<perlvar> for the interpretation of C<$?>).
1738Unlike in B<csh>, no translation is done on the return data--newlines
1739remain newlines. Unlike in any of the shells, single quotes do not
1740hide variable names in the command from interpretation. To pass a
1741literal dollar-sign through to the shell you need to hide it with a
1742backslash. The generalized form of backticks is C<qx//>. (Because
1743backticks always undergo shell expansion as well, see L<perlsec> for
1744security concerns.)
19799a22
GS
1745
1746In scalar context, evaluating a filehandle in angle brackets yields
1747the next line from that file (the newline, if any, included), or
1748C<undef> at end-of-file or on error. When C<$/> is set to C<undef>
1749(sometimes known as file-slurp mode) and the file is empty, it
1750returns C<''> the first time, followed by C<undef> subsequently.
1751
1752Ordinarily you must assign the returned value to a variable, but
1753there is one situation where an automatic assignment happens. If
1754and only if the input symbol is the only thing inside the conditional
1755of a C<while> statement (even if disguised as a C<for(;;)> loop),
1756the value is automatically assigned to the global variable $_,
1757destroying whatever was there previously. (This may seem like an
1758odd thing to you, but you'll use the construct in almost every Perl
17b829fa 1759script you write.) The $_ variable is not implicitly localized.
19799a22
GS
1760You'll have to put a C<local $_;> before the loop if you want that
1761to happen.
1762
1763The following lines are equivalent:
a0d0e21e 1764
748a9306 1765 while (defined($_ = <STDIN>)) { print; }
7b8d334a 1766 while ($_ = <STDIN>) { print; }
a0d0e21e
LW
1767 while (<STDIN>) { print; }
1768 for (;<STDIN>;) { print; }
748a9306 1769 print while defined($_ = <STDIN>);
7b8d334a 1770 print while ($_ = <STDIN>);
a0d0e21e
LW
1771 print while <STDIN>;
1772
19799a22 1773This also behaves similarly, but avoids $_ :
7b8d334a
GS
1774
1775 while (my $line = <STDIN>) { print $line }
1776
19799a22
GS
1777In these loop constructs, the assigned value (whether assignment
1778is automatic or explicit) is then tested to see whether it is
1779defined. The defined test avoids problems where line has a string
1780value that would be treated as false by Perl, for example a "" or
1781a "0" with no trailing newline. If you really mean for such values
1782to terminate the loop, they should be tested for explicitly:
7b8d334a
GS
1783
1784 while (($_ = <STDIN>) ne '0') { ... }
1785 while (<STDIN>) { last unless $_; ... }
1786
35f2feb0 1787In other boolean contexts, C<< <I<filehandle>> >> without an
9f1b1f2d
GS
1788explicit C<defined> test or comparison elicit a warning if the
1789C<use warnings> pragma or the B<-w>
19799a22 1790command-line switch (the C<$^W> variable) is in effect.
7b8d334a 1791
5f05dabc 1792The filehandles STDIN, STDOUT, and STDERR are predefined. (The
19799a22
GS
1793filehandles C<stdin>, C<stdout>, and C<stderr> will also work except
1794in packages, where they would be interpreted as local identifiers
1795rather than global.) Additional filehandles may be created with
1796the open() function, amongst others. See L<perlopentut> and
1797L<perlfunc/open> for details on this.
a0d0e21e 1798
35f2feb0 1799If a <FILEHANDLE> is used in a context that is looking for
19799a22
GS
1800a list, a list comprising all input lines is returned, one line per
1801list element. It's easy to grow to a rather large data space this
1802way, so use with care.
a0d0e21e 1803
35f2feb0 1804<FILEHANDLE> may also be spelled C<readline(*FILEHANDLE)>.
19799a22 1805See L<perlfunc/readline>.
fbad3eb5 1806
35f2feb0
GS
1807The null filehandle <> is special: it can be used to emulate the
1808behavior of B<sed> and B<awk>. Input from <> comes either from
a0d0e21e 1809standard input, or from each file listed on the command line. Here's
35f2feb0 1810how it works: the first time <> is evaluated, the @ARGV array is
5a964f20 1811checked, and if it is empty, C<$ARGV[0]> is set to "-", which when opened
a0d0e21e
LW
1812gives you standard input. The @ARGV array is then processed as a list
1813of filenames. The loop
1814
1815 while (<>) {
1816 ... # code for each line
1817 }
1818
1819is equivalent to the following Perl-like pseudo code:
1820
3e3baf6d 1821 unshift(@ARGV, '-') unless @ARGV;
a0d0e21e
LW
1822 while ($ARGV = shift) {
1823 open(ARGV, $ARGV);
1824 while (<ARGV>) {
1825 ... # code for each line
1826 }
1827 }
1828
19799a22
GS
1829except that it isn't so cumbersome to say, and will actually work.
1830It really does shift the @ARGV array and put the current filename
1831into the $ARGV variable. It also uses filehandle I<ARGV>
35f2feb0 1832internally--<> is just a synonym for <ARGV>, which
19799a22 1833is magical. (The pseudo code above doesn't work because it treats
35f2feb0 1834<ARGV> as non-magical.)
a0d0e21e 1835
35f2feb0 1836You can modify @ARGV before the first <> as long as the array ends up
a0d0e21e 1837containing the list of filenames you really want. Line numbers (C<$.>)
19799a22
GS
1838continue as though the input were one big happy file. See the example
1839in L<perlfunc/eof> for how to reset line numbers on each file.
5a964f20
TC
1840
1841If you want to set @ARGV to your own list of files, go right ahead.
1842This sets @ARGV to all plain text files if no @ARGV was given:
1843
1844 @ARGV = grep { -f && -T } glob('*') unless @ARGV;
a0d0e21e 1845
5a964f20
TC
1846You can even set them to pipe commands. For example, this automatically
1847filters compressed arguments through B<gzip>:
1848
1849 @ARGV = map { /\.(gz|Z)$/ ? "gzip -dc < $_ |" : $_ } @ARGV;
1850
1851If you want to pass switches into your script, you can use one of the
a0d0e21e
LW
1852Getopts modules or put a loop on the front like this:
1853
1854 while ($_ = $ARGV[0], /^-/) {
1855 shift;
1856 last if /^--$/;
1857 if (/^-D(.*)/) { $debug = $1 }
1858 if (/^-v/) { $verbose++ }
5a964f20 1859 # ... # other switches
a0d0e21e 1860 }
5a964f20 1861
a0d0e21e 1862 while (<>) {
5a964f20 1863 # ... # code for each line
a0d0e21e
LW
1864 }
1865
35f2feb0 1866The <> symbol will return C<undef> for end-of-file only once.
19799a22
GS
1867If you call it again after this, it will assume you are processing another
1868@ARGV list, and if you haven't set @ARGV, will read input from STDIN.
a0d0e21e 1869
b159ebd3 1870If what the angle brackets contain is a simple scalar variable (e.g.,
35f2feb0 1871<$foo>), then that variable contains the name of the
19799a22
GS
1872filehandle to input from, or its typeglob, or a reference to the
1873same. For example:
cb1a09d0
AD
1874
1875 $fh = \*STDIN;
1876 $line = <$fh>;
a0d0e21e 1877
5a964f20
TC
1878If what's within the angle brackets is neither a filehandle nor a simple
1879scalar variable containing a filehandle name, typeglob, or typeglob
1880reference, it is interpreted as a filename pattern to be globbed, and
1881either a list of filenames or the next filename in the list is returned,
19799a22 1882depending on context. This distinction is determined on syntactic
35f2feb0
GS
1883grounds alone. That means C<< <$x> >> is always a readline() from
1884an indirect handle, but C<< <$hash{key}> >> is always a glob().
5a964f20
TC
1885That's because $x is a simple scalar variable, but C<$hash{key}> is
1886not--it's a hash element.
1887
1888One level of double-quote interpretation is done first, but you can't
35f2feb0 1889say C<< <$foo> >> because that's an indirect filehandle as explained
5a964f20
TC
1890in the previous paragraph. (In older versions of Perl, programmers
1891would insert curly brackets to force interpretation as a filename glob:
35f2feb0 1892C<< <${foo}> >>. These days, it's considered cleaner to call the
5a964f20 1893internal function directly as C<glob($foo)>, which is probably the right
19799a22 1894way to have done it in the first place.) For example:
a0d0e21e
LW
1895
1896 while (<*.c>) {
1897 chmod 0644, $_;
1898 }
1899
3a4b19e4 1900is roughly equivalent to:
a0d0e21e
LW
1901
1902 open(FOO, "echo *.c | tr -s ' \t\r\f' '\\012\\012\\012\\012'|");
1903 while (<FOO>) {
5b3eff12 1904 chomp;
a0d0e21e
LW
1905 chmod 0644, $_;
1906 }
1907
3a4b19e4
GS
1908except that the globbing is actually done internally using the standard
1909C<File::Glob> extension. Of course, the shortest way to do the above is:
a0d0e21e
LW
1910
1911 chmod 0644, <*.c>;
1912
19799a22
GS
1913A (file)glob evaluates its (embedded) argument only when it is
1914starting a new list. All values must be read before it will start
1915over. In list context, this isn't important because you automatically
1916get them all anyway. However, in scalar context the operator returns
069e01df 1917the next value each time it's called, or C<undef> when the list has
19799a22
GS
1918run out. As with filehandle reads, an automatic C<defined> is
1919generated when the glob occurs in the test part of a C<while>,
1920because legal glob returns (e.g. a file called F<0>) would otherwise
1921terminate the loop. Again, C<undef> is returned only once. So if
1922you're expecting a single value from a glob, it is much better to
1923say
4633a7c4
LW
1924
1925 ($file) = <blurch*>;
1926
1927than
1928
1929 $file = <blurch*>;
1930
1931because the latter will alternate between returning a filename and
19799a22 1932returning false.
4633a7c4 1933
b159ebd3 1934If you're trying to do variable interpolation, it's definitely better
4633a7c4 1935to use the glob() function, because the older notation can cause people
e37d713d 1936to become confused with the indirect filehandle notation.
4633a7c4
LW
1937
1938 @files = glob("$dir/*.[ch]");
1939 @files = glob($files[$i]);
1940
a0d0e21e
LW
1941=head2 Constant Folding
1942
1943Like C, Perl does a certain amount of expression evaluation at
19799a22 1944compile time whenever it determines that all arguments to an
a0d0e21e
LW
1945operator are static and have no side effects. In particular, string
1946concatenation happens at compile time between literals that don't do
19799a22 1947variable substitution. Backslash interpolation also happens at
a0d0e21e
LW
1948compile time. You can say
1949
1950 'Now is the time for all' . "\n" .
1951 'good men to come to.'
1952
54310121 1953and this all reduces to one string internally. Likewise, if
a0d0e21e
LW
1954you say
1955
1956 foreach $file (@filenames) {
5a964f20 1957 if (-s $file > 5 + 100 * 2**16) { }
54310121 1958 }
a0d0e21e 1959
19799a22
GS
1960the compiler will precompute the number which that expression
1961represents so that the interpreter won't have to.
a0d0e21e 1962
2c268ad5
TP
1963=head2 Bitwise String Operators
1964
1965Bitstrings of any size may be manipulated by the bitwise operators
1966(C<~ | & ^>).
1967
19799a22
GS
1968If the operands to a binary bitwise op are strings of different
1969sizes, B<|> and B<^> ops act as though the shorter operand had
1970additional zero bits on the right, while the B<&> op acts as though
1971the longer operand were truncated to the length of the shorter.
1972The granularity for such extension or truncation is one or more
1973bytes.
2c268ad5
TP
1974
1975 # ASCII-based examples
1976 print "j p \n" ^ " a h"; # prints "JAPH\n"
1977 print "JA" | " ph\n"; # prints "japh\n"
1978 print "japh\nJunk" & '_____'; # prints "JAPH\n";
1979 print 'p N$' ^ " E<H\n"; # prints "Perl\n";
1980
19799a22 1981If you are intending to manipulate bitstrings, be certain that
2c268ad5 1982you're supplying bitstrings: If an operand is a number, that will imply
19799a22 1983a B<numeric> bitwise operation. You may explicitly show which type of
2c268ad5
TP
1984operation you intend by using C<""> or C<0+>, as in the examples below.
1985
1986 $foo = 150 | 105 ; # yields 255 (0x96 | 0x69 is 0xFF)
1987 $foo = '150' | 105 ; # yields 255
1988 $foo = 150 | '105'; # yields 255
1989 $foo = '150' | '105'; # yields string '155' (under ASCII)
1990
1991 $baz = 0+$foo & 0+$bar; # both ops explicitly numeric
1992 $biz = "$foo" ^ "$bar"; # both ops explicitly stringy
a0d0e21e 1993
1ae175c8
GS
1994See L<perlfunc/vec> for information on how to manipulate individual bits
1995in a bit vector.
1996
55497cff 1997=head2 Integer Arithmetic
a0d0e21e 1998
19799a22 1999By default, Perl assumes that it must do most of its arithmetic in
a0d0e21e
LW
2000floating point. But by saying
2001
2002 use integer;
2003
2004you may tell the compiler that it's okay to use integer operations
19799a22
GS
2005(if it feels like it) from here to the end of the enclosing BLOCK.
2006An inner BLOCK may countermand this by saying
a0d0e21e
LW
2007
2008 no integer;
2009
19799a22
GS
2010which lasts until the end of that BLOCK. Note that this doesn't
2011mean everything is only an integer, merely that Perl may use integer
2012operations if it is so inclined. For example, even under C<use
2013integer>, if you take the C<sqrt(2)>, you'll still get C<1.4142135623731>
2014or so.
2015
2016Used on numbers, the bitwise operators ("&", "|", "^", "~", "<<",
13a2d996
SP
2017and ">>") always produce integral results. (But see also
2018L<Bitwise String Operators>.) However, C<use integer> still has meaning for
19799a22
GS
2019them. By default, their results are interpreted as unsigned integers, but
2020if C<use integer> is in effect, their results are interpreted
2021as signed integers. For example, C<~0> usually evaluates to a large
2022integral value. However, C<use integer; ~0> is C<-1> on twos-complement
2023machines.
68dc0745 2024
2025=head2 Floating-point Arithmetic
2026
2027While C<use integer> provides integer-only arithmetic, there is no
19799a22
GS
2028analogous mechanism to provide automatic rounding or truncation to a
2029certain number of decimal places. For rounding to a certain number
2030of digits, sprintf() or printf() is usually the easiest route.
2031See L<perlfaq4>.
68dc0745 2032
5a964f20
TC
2033Floating-point numbers are only approximations to what a mathematician
2034would call real numbers. There are infinitely more reals than floats,
2035so some corners must be cut. For example:
2036
2037 printf "%.20g\n", 123456789123456789;
2038 # produces 123456789123456784
2039
2040Testing for exact equality of floating-point equality or inequality is
2041not a good idea. Here's a (relatively expensive) work-around to compare
2042whether two floating-point numbers are equal to a particular number of
2043decimal places. See Knuth, volume II, for a more robust treatment of
2044this topic.
2045
2046 sub fp_equal {
2047 my ($X, $Y, $POINTS) = @_;
2048 my ($tX, $tY);
2049 $tX = sprintf("%.${POINTS}g", $X);
2050 $tY = sprintf("%.${POINTS}g", $Y);
2051 return $tX eq $tY;
2052 }
2053
68dc0745 2054The POSIX module (part of the standard perl distribution) implements
19799a22
GS
2055ceil(), floor(), and other mathematical and trigonometric functions.
2056The Math::Complex module (part of the standard perl distribution)
2057defines mathematical functions that work on both the reals and the
2058imaginary numbers. Math::Complex not as efficient as POSIX, but
68dc0745 2059POSIX can't work with complex numbers.
2060
2061Rounding in financial applications can have serious implications, and
2062the rounding method used should be specified precisely. In these
2063cases, it probably pays not to trust whichever system rounding is
2064being used by Perl, but to instead implement the rounding function you
2065need yourself.
5a964f20
TC
2066
2067=head2 Bigger Numbers
2068
2069The standard Math::BigInt and Math::BigFloat modules provide
19799a22 2070variable-precision arithmetic and overloaded operators, although
cd5c4fce 2071they're currently pretty slow. At the cost of some space and
19799a22
GS
2072considerable speed, they avoid the normal pitfalls associated with
2073limited-precision representations.
5a964f20
TC
2074
2075 use Math::BigInt;
2076 $x = Math::BigInt->new('123456789123456789');
2077 print $x * $x;
2078
2079 # prints +15241578780673678515622620750190521
19799a22 2080
cd5c4fce
T
2081There are several modules that let you calculate with (bound only by
2082memory and cpu-time) unlimited or fixed precision. There are also
2083some non-standard modules that provide faster implementations via
2084external C libraries.
2085
2086Here is a short, but incomplete summary:
2087
2088 Math::Fraction big, unlimited fractions like 9973 / 12967
2089 Math::String treat string sequences like numbers
2090 Math::FixedPrecision calculate with a fixed precision
2091 Math::Currency for currency calculations
2092 Bit::Vector manipulate bit vectors fast (uses C)
2093 Math::BigIntFast Bit::Vector wrapper for big numbers
2094 Math::Pari provides access to the Pari C library
2095 Math::BigInteger uses an external C library
2096 Math::Cephes uses external Cephes C library (no big numbers)
2097 Math::Cephes::Fraction fractions via the Cephes library
2098 Math::GMP another one using an external C library
2099
2100Choose wisely.
16070b82
GS
2101
2102=cut