This is a live mirror of the Perl 5 development currently hosted at https://github.com/perl/perl5
perldelta: Fill in missing module name
[perl5.git] / pod / perldelta.pod
CommitLineData
44691e6f
AB
1=encoding utf8
2
3=head1 NAME
4
5076a392 5perldelta - what is new for perl v5.14.0
c71a852f 6
5076a392
FC
7=head1 DESCRIPTION
8
9This document describes differences between the 5.12.0 release and
10the 5.14.0 release.
11
0980abf1
FC
12If you are upgrading from an earlier release such as 5.10.0, first read
13L<perl5120delta>, which describes differences between 5.10.0 and
145.12.0.
15
5076a392
FC
16Some of the bug fixes in this release have been backported to subsequent
17releases of 5.12.x. Those are indicated with the 5.12.x version in
18parentheses.
19
5076a392
FC
20=head1 Notice
21
22XXX Any important notices here
23
24=head1 Core Enhancements
25
1f539a1a 26=head2 Unicode
5076a392 27
1f539a1a 28=head3 Unicode Version 6.0 is now supported (mostly)
5076a392 29
1f539a1a
FC
30Perl comes with the Unicode 6.0 data base updated with
31L<Corrigendum #8|http://www.unicode.org/versions/corrigendum8.html>,
32with one exception noted below.
33See L<http://unicode.org/versions/Unicode6.0.0> for details on the new
34release. Perl does not support any Unicode provisional properties,
a3c24add 35including the new ones for this release.
5076a392 36
1f539a1a 37Unicode 6.0 has chosen to use the name C<BELL> for the character at U+1F514,
e1b1739f 38which is a symbol that looks like a bell, and is used in Japanese cell
1f539a1a
FC
39phones. This conflicts with the long-standing Perl usage of having
40C<BELL> mean the ASCII C<BEL> character, U+0007. In Perl 5.14,
41C<\N{BELL}> will continue to mean U+0007, but its use will generate a
42deprecated warning message, unless such warnings are turned off. The
43new name for U+0007 in Perl will be C<ALERT>, which corresponds nicely
44with the existing shorthand sequence for it, C<"\a">. C<\N{BEL}> will
45mean U+0007, with no warning given. The character at U+1F514 will not
46have a name in 5.14, but can be referred to by C<\N{U+1F514}>. The plan
47is that in Perl 5.16, C<\N{BELL}> will refer to U+1F514, and so all code
48that uses C<\N{BELL}> should convert by then to using C<\N{ALERT}>,
49C<\N{BEL}>, or C<"\a"> instead.
5076a392 50
1f539a1a 51=head3 Full functionality for C<use feature 'unicode_strings'>
5076a392 52
1f539a1a
FC
53This release provides full functionality for C<use feature
54'unicode_strings'>. Under its scope, all string operations executed and
55regular expressions compiled (even if executed outside its scope) have
56Unicode semantics. See L<feature>.
5076a392 57
1f539a1a
FC
58This feature avoids most forms of the "Unicode Bug" (See
59L<perlunicode/The "Unicode Bug"> for details.) If there is a
60possibility that your code will process Unicode strings, you are
61B<strongly> encouraged to use this subpragma to avoid nasty surprises.
5076a392 62
1f539a1a 63=head3 C<\N{I<name>}> and C<charnames> enhancements
5076a392 64
1f539a1a 65=over
5076a392 66
1f539a1a 67=item *
5076a392
FC
68
69C<\N{}> and C<charnames::vianame> now know about the abbreviated
e1b1739f
FC
70character names listed by Unicode, such as NBSP, SHY, LRO, ZWJ, etc., all
71the customary abbreviations for the C0 and C1 control characters (such as
72ACK, BEL, CAN, etc.), and a few new variants of some C1 full names that
73are in common usage.
5076a392 74
1f539a1a
FC
75=item *
76
959ad7d5
FC
77Unicode has a number of named character sequences, in which particular sequences
78of code points are given names. C<\N{...}> now recognizes these.
79
1f539a1a
FC
80=item *
81
959ad7d5
FC
82C<\N{}>, C<charnames::vianame>, C<charnames::viacode> now know about every
83character in Unicode. Previously, they didn't know about the Hangul syllables
84nor a number of CJK (Chinese/Japanese/Korean) characters.
85
1f539a1a
FC
86=item *
87
5076a392
FC
88In the past, it was ineffective to override one of Perl's abbreviations
89with your own custom alias. Now it works.
90
1f539a1a
FC
91=item *
92
e1b1739f 93You can also create a custom alias of the ordinal of a
5076a392
FC
94character, known by C<\N{...}>, C<charnames::vianame()>, and
95C<charnames::viacode()>. Previously, an alias had to be to an official
96Unicode character name. This made it impossible to create an alias for
e1b1739f
FC
97a code point that had no name, such as those reserved for private
98use.
5076a392 99
1f539a1a
FC
100=item *
101
959ad7d5
FC
102A new function, C<charnames::string_vianame()>, has been added.
103This function is a run-time version of C<\N{...}>, returning the string
104of characters whose Unicode name is its parameter. It can handle
105Unicode named character sequences, whereas the pre-existing
106C<charnames::vianame()> cannot, as the latter returns a single code
107point.
108
1f539a1a
FC
109=back
110
5076a392
FC
111See L<charnames> for details on all these changes.
112
22349846
KW
113=head3 New warnings categories for problematic (non-)Unicode code points.
114
115Three new warnings subcategories of "utf8" have been added. These
116allow you to turn off some "utf8" warnings, while allowing
117others warnings to remain on. The three categories are:
118C<surrogate> when UTF-16 surrogates are encountered;
119C<nonchar> when Unicode non-character code points are encountered;
120and C<non_unicode> when code points that are above the legal Unicode
121maximum of 0x10FFFF are encountered.
122
1f539a1a 123=head3 Any unsigned value can be encoded as a character
5076a392 124
1f539a1a
FC
125With this release, Perl is adopting a model that any unsigned value can
126be treated as a code point and encoded internally (as utf8) without
54c7bb16 127warnings - not just the code points that are legal in Unicode.
22349846
KW
128However, unless utf8 or the corresponding sub-category (see previous
129item) warnings have been
1f539a1a
FC
130explicitly lexically turned off, outputting or performing a
131Unicode-defined operation (such as upper-casing) on such a code point
132will generate a warning. Attempting to input these using strict rules
133(such as with the C<:encoding('UTF-8')> layer) will continue to fail.
134Prior to this release the handling was very inconsistent, and incorrect
135in places. Also, the Unicode non-characters, some of which previously were
136erroneously considered illegal in places by Perl, contrary to the Unicode
137standard, are now always legal internally. But inputting or outputting
138them will work the same as for the non-legal Unicode code points, as the
139Unicode standard says they are illegal for "open interchange".
5076a392 140
1f539a1a 141=head2 Regular Expressions
5076a392 142
1f539a1a 143=head3 C<(?^...)> construct to signify default modifiers
5076a392 144
e1b1739f
FC
145An ASCII caret (also called a "circumflex accent") C<"^">
146immediately following a C<"(?"> in a regular expression
147now means that the subexpression does not inherit the
148surrounding modifiers such as C</i>, but reverts to the
5076a392
FC
149Perl defaults. Any modifiers following the caret override the defaults.
150
151The stringification of regular expressions now uses this
152notation. E.g., before, C<qr/hlagh/i> would be stringified as
153C<(?i-xsm:hlagh)>, but now it's stringified as C<(?^i:hlagh)>.
154
155The main purpose of this is to allow tests that rely on the
e1b1739f 156stringification not to have to change when new modifiers are added.
5076a392
FC
157See L<perlre/Extended Patterns>.
158
1f539a1a 159=head3 C</d>, C</l>, C</u>, C</a>, and C</aa> modifiers
5076a392 160
959ad7d5
FC
161Four new regular expression modifiers have been added. These are mutually
162exclusive; one only can be turned on at a time.
5076a392 163
959ad7d5 164The C</l> modifier says to compile the regular expression as if it were
5076a392
FC
165in the scope of C<use locale>, even if it is not.
166
959ad7d5 167The C</u> modifier says to compile the regular expression as if it were
5076a392
FC
168in the scope of a C<use feature "unicode_strings"> pragma.
169
e1b1739f 170The C</d> (default) modifier is used to override any C<use locale> and
5076a392
FC
171C<use feature "unicode_strings"> pragmas that are in effect at the time
172of compiling the regular expression.
173
959ad7d5 174The C</a> regular expression modifier restricts C<\s>, C<\d> and C<\w> and
7baaf023 175the Posix (C<[[:posix:]]>) character classes to the ASCII range. Their
959ad7d5
FC
176complements and C<\b> and C<\B> are correspondingly
177affected. Otherwise, C</a> behaves like the C</u> modifier, in that
e1b1739f 178case-insensitive matching uses Unicode semantics.
5076a392 179
959ad7d5
FC
180The C</aa> modifier is like C</a>, except that, in case-insensitive matching, no ASCII character will match a
181non-ASCII character. For example,
5076a392 182
959ad7d5 183 'k' =~ /\N{KELVIN SIGN}/ai
5076a392 184
959ad7d5 185will match; it won't under C</aa>.
5076a392 186
959ad7d5 187See L<perlre/Modifiers> for more detail.
5076a392 188
1f539a1a 189=head3 Non-destructive substitution
5076a392 190
1f539a1a
FC
191The substitution (C<s///>) and transliteration
192(C<y///>) operators now support an C</r> option that
193copies the input variable, carries out the substitution on
194the copy and returns the result. The original remains unmodified.
5076a392 195
1f539a1a
FC
196 my $old = 'cat';
197 my $new = $old =~ s/cat/dog/r;
198 # $old is 'cat' and $new is 'dog'
5076a392 199
1f539a1a 200This is particularly useful with C<map>. See L<perlop> for more examples.
5076a392 201
1f539a1a 202=head3 Reentrant regular expression engine
5076a392 203
1f539a1a
FC
204It is now safe to use regular expressions within C<(?{...})> and
205C<(??{...})> code blocks inside regular expressions.
5076a392 206
1f539a1a 207These block are still experimental, however, and still have problems with
e1b1739f 208lexical (C<my>) variables and abnormal exiting.
5076a392 209
1f539a1a 210=head3 C<use re '/flags';>
5076a392
FC
211
212The C<re> pragma now has the ability to turn on regular expression flags
213till the end of the lexical scope:
214
215 use re '/x';
216 "foo" =~ / (.+) /; # /x implied
217
218See L<re/"'/flags' mode"> for details.
219
1f539a1a 220=head3 \o{...} for octals
5076a392 221
e1b1739f
FC
222There is a new octal escape sequence, C<"\o">, in double-quote-like
223contexts. This construct allows large octal ordinals beyond the
1f539a1a
FC
224current max of 0777 to be represented. It also allows you to specify a
225character in octal which can safely be concatenated with other regex
226snippets and which won't be confused with being a backreference to
227a regex capture group. See L<perlre/Capture groups>.
228
229=head3 Add C<\p{Titlecase}> as a synonym for C<\p{Title}>
230
231This synonym is added for symmetry with the Unicode property names
232C<\p{Uppercase}> and C<\p{Lowercase}>.
5076a392 233
1f539a1a
FC
234=head3 Regular expression debugging output improvement
235
236Regular expression debugging output (turned on by C<use re 'debug';>) now
237uses hexadecimal when escaping non-ASCII characters, instead of octal.
238
1e463951
FC
239=head3 Return value of C<delete $+{...}>
240
241Custom regular expression engines can now determine the return value of
242C<delete> on an entry of C<%+> or C<%->.
243
1f539a1a
FC
244=head2 Syntactical Enhancements
245
246=head3 Array and hash container functions accept references
5076a392
FC
247
248All built-in functions that operate directly on array or hash
249containers now also accept hard references to arrays or hashes:
250
251 |----------------------------+---------------------------|
252 | Traditional syntax | Terse syntax |
253 |----------------------------+---------------------------|
254 | push @$arrayref, @stuff | push $arrayref, @stuff |
255 | unshift @$arrayref, @stuff | unshift $arrayref, @stuff |
256 | pop @$arrayref | pop $arrayref |
257 | shift @$arrayref | shift $arrayref |
258 | splice @$arrayref, 0, 2 | splice $arrayref, 0, 2 |
259 | keys %$hashref | keys $hashref |
260 | keys @$arrayref | keys $arrayref |
261 | values %$hashref | values $hashref |
262 | values @$arrayref | values $arrayref |
263 | ($k,$v) = each %$hashref | ($k,$v) = each $hashref |
264 | ($k,$v) = each @$arrayref | ($k,$v) = each $arrayref |
265 |----------------------------+---------------------------|
266
267This allows these built-in functions to act on long dereferencing chains
268or on the return value of subroutines without needing to wrap them in
269C<@{}> or C<%{}>:
270
271 push @{$obj->tags}, $new_tag; # old way
272 push $obj->tags, $new_tag; # new way
273
274 for ( keys %{$hoh->{genres}{artists}} ) {...} # old way
275 for ( keys $hoh->{genres}{artists} ) {...} # new way
276
277For C<push>, C<unshift> and C<splice>, the reference will auto-vivify
278if it is not defined, just as if it were wrapped with C<@{}>.
279
5076a392
FC
280For C<keys>, C<values>, C<each>, when overloaded dereferencing is
281present, the overloaded dereference is used instead of dereferencing the
e1b1739f
FC
282underlying reftype. Warnings are issued about assumptions made in
283ambiguous cases.
5076a392 284
1f539a1a
FC
285=head3 Single term prototype
286
287The C<+> prototype is a special alternative to C<$> that will act like
288C<\[@%]> when given a literal array or hash variable, but will otherwise
e1b1739f 289force scalar context on the argument. See L<perlsub/Prototypes>.
1f539a1a
FC
290
291=head3 C<package> block syntax
292
293A package declaration can now contain a code block, in which case the
294declaration is in scope only inside that block. So C<package Foo { ... }>
295is precisely equivalent to C<{ package Foo; ... }>. It also works with
296a version number in the declaration, as in C<package Foo 1.2 { ... }>.
e1b1739f 297See L<perlfunc>.
1f539a1a
FC
298
299=head3 Statement labels can appear in more places
300
301Statement labels can now occur before any type of statement or declaration,
302such as C<package>.
303
304=head3 Stacked labels
305
306Multiple statement labels can now appear before a single statement.
307
308=head3 Uppercase X/B allowed in hexadecimal/binary literals
309
310Literals may now use either upper case C<0X...> or C<0B...> prefixes,
311in addition to the already supported C<0x...> and C<0b...>
e1b1739f 312syntax [perl #76296].
1f539a1a
FC
313
314C, Ruby, Python and PHP already supported this syntax, and it makes
315Perl more internally consistent. A round-trip with C<eval sprintf
e1b1739f 316"%#X", 0x10> now returns C<16>, the way C<eval sprintf "%#x", 0x10> does.
1f539a1a 317
1e463951
FC
318=head3 Overridable tie functions
319
320C<tie>, C<tied> and C<untie> can now be overridden [perl #75902].
321
1f539a1a
FC
322=head2 Exception Handling
323
324Several changes have been made to the way C<die>, C<warn>, and C<$@>
325behave, in order to make them more reliable and consistent.
326
327When an exception is thrown inside an C<eval>, the exception is no
328longer at risk of being clobbered by code running during unwinding
329(e.g., destructors). Previously, the exception was written into C<$@>
330early in the throwing process, and would be overwritten if C<eval> was
331used internally in the destructor for an object that had to be freed
332while exiting from the outer C<eval>. Now the exception is written
333into C<$@> last thing before exiting the outer C<eval>, so the code
334running immediately thereafter can rely on the value in C<$@> correctly
335corresponding to that C<eval>. (C<$@> is still also set before exiting the
336C<eval>, for the sake of destructors that rely on this.)
337
338Likewise, a C<local $@> inside an C<eval> will no longer clobber any
339exception thrown in its scope. Previously, the restoration of C<$@> upon
340unwinding would overwrite any exception being thrown. Now the exception
341gets to the C<eval> anyway. So C<local $@> is safe before a C<die>.
342
343Exceptions thrown from object destructors no longer modify the C<$@>
344of the surrounding context. (If the surrounding context was exception
345unwinding, this used to be another way to clobber the exception being
346thrown.) Previously such an exception was
347sometimes emitted as a warning, and then either was
348string-appended to the surrounding C<$@> or completely replaced the
349surrounding C<$@>, depending on whether that exception and the surrounding
350C<$@> were strings or objects. Now, an exception in this situation is
351always emitted as a warning, leaving the surrounding C<$@> untouched.
352In addition to object destructors, this also affects any function call
353performed by XS code using the C<G_KEEPERR> flag.
354
355Warnings for C<warn> can now be objects, in the same way as exceptions
356for C<die>. If an object-based warning gets the default handling,
357of writing to standard error, it is stringified as
358before, with the file and line number appended. But
359a C<$SIG{__WARN__}> handler will now receive an
360object-based warning as an object, where previously it was passed the
361result of stringifying the object.
362
363=head2 Other Enhancements
364
365=head3 Assignment to C<$0> sets the legacy process name with C<prctl()> on Linux
366
367On Linux the legacy process name will be set with L<prctl(2)>, in
368addition to altering the POSIX name via C<argv[0]> as perl has done
369since version 4.000. Now system utilities that read the legacy process
370name such as ps, top and killall will recognize the name you set when
371assigning to C<$0>. The string you supply will be cut off at 16 bytes,
372this is a limitation imposed by Linux.
373
374=head3 C<srand()> now returns the seed
375
e1b1739f
FC
376This allows programs that need to have repeatable results not to have to come
377up with their own seed-generating mechanism. Instead, they can use C<srand()>
378and stash the return value for future use. Typical is a test program which
1f539a1a 379has too many combinations to test comprehensively in the time available to it
e1b1739f 380each run. It can test a random subset each time and, should there be a failure,
1f539a1a 381log the seed used for that run so that it can later be used to reproduce the
e1b1739f 382same results.
1f539a1a
FC
383
384=head3 printf-like functions understand post-1980 size modifiers
385
386Perl's printf and sprintf operators, and Perl's internal printf replacement
387function, now understand the C90 size modifiers "hh" (C<char>), "z"
388(C<size_t>), and "t" (C<ptrdiff_t>). Also, when compiled with a C99
389compiler, Perl now understands the size modifier "j" (C<intmax_t>).
390
391So, for example, on any modern machine, C<sprintf('%hhd', 257)> returns '1'.
392
393=head3 New global variable C<${^GLOBAL_PHASE}>
5076a392
FC
394
395A new global variable, C<${^GLOBAL_PHASE}>, has been added to allow
396introspection of the current phase of the perl interpreter. It's explained in
397detail in L<perlvar/"${^GLOBAL_PHASE}"> and
398L<perlmod/"BEGIN, UNITCHECK, CHECK, INIT and END">.
399
1f539a1a 400=head3 C<-d:-foo> calls C<Devel::foo::unimport>
5076a392
FC
401
402The syntax C<-dI<B<:>foo>> was extended in 5.6.1 to make C<-dI<:fooB<=bar>>>
403equivalent to C<-MDevel::foo=bar>, which expands
404internally to C<use Devel::foo 'bar';>.
405F<perl> now allows prefixing the module name with C<->, with the same
406semantics as C<-M>, I<i.e.>
407
408=over 4
409
410=item C<-d:-foo>
411
412Equivalent to C<-M-Devel::foo>, expands to
413C<no Devel::foo;>, calls C<< Devel::foo->unimport() >>
414if the method exists.
415
416=item C<-d:-foo=bar>
417
418Equivalent to C<-M-Devel::foo=bar>, expands to C<no Devel::foo 'bar';>,
419calls C<< Devel::foo->unimport('bar') >> if the method exists.
420
421=back
422
e1b1739f 423This is particularly useful for suppressing the default actions of a
5076a392
FC
424C<Devel::*> module's C<import> method whilst still loading it for debugging.
425
1f539a1a 426=head3 Filehandle method calls load L<IO::File> on demand
5076a392
FC
427
428When a method call on a filehandle would die because the method cannot
429be resolved, and L<IO::File> has not been loaded, Perl now loads L<IO::File>
430via C<require> and attempts method resolution again:
431
432 open my $fh, ">", $file;
433 $fh->binmode(":raw"); # loads IO::File and succeeds
434
435This also works for globs like STDOUT, STDERR and STDIN:
436
437 STDOUT->autoflush(1);
438
439Because this on-demand load only happens if method resolution fails, the
440legacy approach of manually loading an L<IO::File> parent class for partial
441method support still works as expected:
442
443 use IO::Handle;
444 open my $fh, ">", $file;
445 $fh->autoflush(1); # IO::File not loaded
446
1984204c
FC
447=head3 IPv6 support
448
449The C<Socket> module provides new affordances for IPv6,
450including implementations of the C<Socket::getaddrinfo()> and
451C<Socket::getnameinfo()> functions, along with related constants, and a
452handful of new functions. See L<Socket>.
453
1f539a1a 454=head3 DTrace probes now include package name
5076a392
FC
455
456The DTrace probes now include an additional argument (C<arg3>) which contains
457the package the subroutine being entered or left was compiled in.
458
459For example using the following DTrace script:
460
461 perl$target:::sub-entry
462 {
463 printf("%s::%s\n", copyinstr(arg0), copyinstr(arg3));
464 }
465
466and then running:
467
468 perl -e'sub test { }; test'
469
470DTrace will print:
471
472 main::test
473
9378886b
FC
474=head2 New C APIs
475
1e463951 476See L</Internal Changes>.
9378886b 477
5076a392
FC
478=head1 Security
479
948b8455 480=head2 User-defined regular expression properties
5076a392
FC
481
482In L<perlunicode/"User-Defined Character Properties">, it says you can
483create custom properties by defining subroutines whose names begin with
948b8455
FC
484"In" or "Is". However, Perl did not actually enforce that naming
485restriction, so \p{foo::bar} could call foo::bar() if it existed. Now this
486convention has been enforced.
5076a392 487
948b8455
FC
488Also, Perl no longer allows a tainted regular expression to invoke a
489user-defined. It simply dies instead [perl #82616].
5076a392
FC
490
491=head1 Incompatible Changes
492
61752d82
FC
493Perl 5.14.0 is not binary-compatible with any previous stable release.
494
1e463951
FC
495In addition to the sections that follow, see L</C API Changes>.
496
61752d82
FC
497=head2 Regular Expressions and String Escapes
498
54c7bb16 499=head3 \400-\777
5076a392 500
54c7bb16 501Use of C<\400>-C<\777> in regexes in certain circumstances has given
5076a392
FC
502different, anomalous behavior than their use in all other
503double-quote-like contexts. Since 5.10.1, a deprecated warning message
504has been raised when this happens. Now, all double-quote-like contexts
505have the same behavior, namely to be equivalent to C<\x{100}> -
506C<\x{1FF}>, with no deprecation warning. Use of these values in the
507command line option C<"-0"> retains the current meaning to slurp input
508files whole; previously, this was documented only for C<"-0777">. It is
509recommended, however, because of various ambiguities, to use the new
510C<\o{...}> construct to represent characters in octal.
5076a392 511
61752d82 512=head3 Most C<\p{}> properties are now immune to case-insensitive matching
5076a392 513
61752d82
FC
514For most Unicode properties, it doesn't make sense to have them match
515differently under C</i> case-insensitive matching than not. And doing
516so leads to unexpected results and potential security holes. For
517example
5076a392 518
61752d82 519 m/\p{ASCII_Hex_Digit}+/i
5076a392 520
61752d82
FC
521could previously match non-ASCII characters because of the Unicode
522matching rules. There were a number of bugs in this feature until an
523earlier release in the 5.13 series. Now this release reverts, and
524removes the feature completely except for the few properties where
525people have come to expect it, namely the ones where casing is an
526integral part of their functionality, such as C<m/\p{Uppercase}/i> and
527C<m/\p{Lowercase}/i>, both of which match the exact same code points,
528namely those matched by C<m/\p{Cased}/i>. Details are in
529L<perlrecharclass/Unicode Properties>.
5076a392 530
61752d82
FC
531XXX The mention of ‘until an earlier release in the 5.13 series’ needs to
532change, but I do not fully understand what happened here.
5076a392 533
61752d82
FC
534User-defined property handlers that need to match differently under
535C</i> must change to read the new boolean parameter passed to it which is
536non-zero if case-insensitive matching is in effect or 0 otherwise. See
537L<perluniprops/User-Defined Character Properties>.
5076a392 538
61752d82 539=head3 \p{} implies Unicode semantics
5076a392 540
61752d82
FC
541Now, a Unicode property match specified in the pattern will indicate
542that the pattern is meant for matching according to Unicode rules, the way
543C<\x{}> does.
5076a392 544
61752d82 545=head3 Regular expressions retain their localeness when interpolated
5076a392 546
61752d82
FC
547Regular expressions compiled under C<"use locale"> now retain this when
548interpolated into a new regular expression compiled outside a
549C<"use locale">, and vice-versa.
5076a392 550
61752d82
FC
551Previously, a regular expression interpolated into another one inherited
552the localeness of the surrounding one, losing whatever state it
553originally had. This is considered a bug fix, but may trip up code that
554has come to rely on the incorrect behavior.
5076a392 555
61752d82 556=head3 Stringification of regexes has changed
5076a392
FC
557
558Default regular expression modifiers are now notated by using
559C<(?^...)>. Code relying on the old stringification will fail. The
560purpose of this is so that when new modifiers are added, such code will
561not have to change (after this one time), as the stringification will
562automatically incorporate the new modifiers.
563
564Code that needs to work properly with both old- and new-style regexes
f318e2e6 565can avoid the whole issue by using (for Perls since 5.9.5; see L<re>):
5076a392
FC
566
567 use re qw(regexp_pattern);
568 my ($pat, $mods) = regexp_pattern($re_ref);
569
5076a392
FC
570If the actual stringification is important, or older Perls need to be
571supported, you can use something like the following:
572
573 # Accept both old and new-style stringification
574 my $modifiers = (qr/foobar/ =~ /\Q(?^/) ? '^' : '-xism';
575
576And then use C<$modifiers> instead of C<-xism>.
577
61752d82 578=head3 Run-time code blocks in regular expressions inherit pragmata
5076a392 579
61752d82
FC
580Code blocks in regular expressions (C<(?{...})> and C<(??{...})>) used not
581to inherit any pragmata (strict, warnings, etc.) if the regular expression
582was compiled at run time as happens in cases like these two:
5076a392 583
61752d82
FC
584 use re 'eval';
585 $foo =~ $bar; # when $bar contains (?{...})
586 $foo =~ /$bar(?{ $finished = 1 })/;
587
588This was a bug, which has now been fixed. But it has the potential to break
589any code that was relying on it.
5076a392 590
61752d82 591=head2 Stashes and Package Variables
5076a392 592
61752d82 593=head3 Localised tied hashes and arrays are no longed tied
5076a392 594
61752d82 595In the following:
5076a392 596
61752d82
FC
597 tie @a, ...;
598 {
599 local @a;
600 # here, @a is a now a new, untied array
601 }
602 # here, @a refers again to the old, tied array
5076a392 603
61752d82
FC
604The new local array used to be made tied too, which was fairly pointless,
605and has now been fixed. This fix could however potentially cause a change
606in behaviour of some code.
5076a392 607
61752d82 608=head3 Stashes are now always defined
5076a392 609
61752d82
FC
610C<defined %Foo::> now always returns true, even when no symbols have yet been
611defined in that package.
5076a392 612
61752d82
FC
613This is a side effect of removing a special case kludge in the tokeniser,
614added for 5.10.0, to hide side effects of changes to the internal storage of
615hashes that drastically reduce their memory usage overhead.
616
617Calling defined on a stash has been deprecated since 5.6.0, warned on
618lexicals since 5.6.0, and warned for stashes (and other package
619variables) since 5.12.0. C<defined %hash> has always exposed an
620implementation detail - emptying a hash by deleting all entries from it does
621not make C<defined %hash> false, hence C<defined %hash> is not valid code to
622determine whether an arbitrary hash is empty. Instead, use the behaviour
623that an empty C<%hash> always returns false in a scalar context.
624
625=head3 Dereferencing typeglobs
5076a392
FC
626
627If you assign a typeglob to a scalar variable:
628
629 $glob = *foo;
630
631the glob that is copied to C<$glob> is marked with a special flag
632indicating that the glob is just a copy. This allows subsequent assignments
633to C<$glob> to overwrite the glob. The original glob, however, is
634immutable.
635
636Many Perl operators did not distinguish between these two types of globs.
637This would result in strange behaviour in edge cases: C<untie $scalar>
638would do nothing if the last thing assigned to the scalar was a glob
639(because it treated it as C<untie *$scalar>, which unties a handle).
f318e2e6 640Assignment to a glob slot (e.g., C<*$glob = \@some_array>) would simply
5076a392
FC
641assign C<\@some_array> to C<$glob>.
642
643To fix this, the C<*{}> operator (including the C<*foo> and C<*$foo> forms)
644has been modified to make a new immutable glob if its operand is a glob
e262cb24
FC
645copy. This allows operators that make a distinction between globs and
646scalars to be modified to treat only immutable globs as globs. (C<tie>,
647C<tied> and C<untie> have been left as they are for compatibility's sake,
61752d82 648but will warn. See L</Deprecations>.)
5076a392
FC
649
650This causes an incompatible change in code that assigns a glob to the
651return value of C<*{}> when that operator was passed a glob copy. Take the
652following code, for instance:
653
654 $glob = *foo;
655 *$glob = *bar;
656
657The C<*$glob> on the second line returns a new immutable glob. That new
658glob is made an alias to C<*bar>. Then it is discarded. So the second
659assignment has no effect.
660
5076a392
FC
661See L<http://rt.perl.org/rt3/Public/Bug/Display.html?id=77810> for even
662more detail.
663
61752d82 664=head3 Clearing stashes
5076a392
FC
665
666Stash list assignment C<%foo:: = ()> used to make the stash anonymous
667temporarily while it was being emptied. Consequently, any of its
668subroutines referenced elsewhere would become anonymous (showing up as
669"(unknown)" in C<caller>). Now they retain their package names, such that
670C<caller> will return the original sub name if there is still a reference
671to its typeglob, or "foo::__ANON__" otherwise [perl #79208].
672
61752d82
FC
673=head3 Magic variables outside the main package
674
675In previous versions of Perl, magic variables like C<$!>, C<%SIG>, etc. would
676'leak' into other packages. So C<%foo::SIG> could be used to access signals,
677C<${"foo::!"}> (with strict mode off) to access C's C<errno>, etc.
678
679This was a bug, or an 'unintentional' feature, which caused various ill effects,
680such as signal handlers being wiped when modules were loaded, etc.
681
682This has been fixed (or the feature has been removed, depending on how you see
683it).
684
685=head2 Changes to Syntax or to Perl Operators
686
687=head3 C<given> return values
688
689C<given> blocks now return the last evaluated
690expression, or an empty list if the block was exited by C<break>. Thus you
691can now write:
692
693 my $type = do {
694 given ($num) {
695 break when undef;
696 'integer' when /^[+-]?[0-9]+$/;
697 'float' when /^[+-]?[0-9]+(?:\.[0-9]+)?$/;
698 'unknown';
699 }
700 };
701
702See L<perlsyn/Return value> for details.
703
704=head3 Change in the parsing of certain prototypes
705
706Functions declared with the following prototypes now behave correctly as unary
707functions:
708
709 *
710 \$ \% \@ \* \&
711 \[...]
712 ;$ ;*
713 ;\$ ;\% etc.
714 ;\[...]
715
716Due to this bug fix [perl #75904], functions
717using the C<(*)>, C<(;$)> and C<(;*)> prototypes
718are parsed with higher precedence than before. So in the following example:
719
720 sub foo($);
721 foo $a < $b;
722
723the second line is now parsed correctly as C<< foo($a) < $b >>, rather than
724C<< foo($a < $b) >>. This happens when one of these operators is used in
725an unparenthesised argument:
726
727 < > <= >= lt gt le ge
728 == != <=> eq ne cmp ~~
729 &
730 | ^
731 &&
732 || //
733 .. ...
734 ?:
735 = += -= *= etc.
736
737=head3 Smart-matching against array slices
738
739Previously, the following code resulted in a successful match:
740
741 my @a = qw(a y0 z);
742 my @b = qw(a x0 z);
743 @a[0 .. $#b] ~~ @b;
744
745This odd behaviour has now been fixed [perl #77468].
746
747=head3 Negation treats strings differently from before
748
749The unary negation operator C<-> now treats strings that look like numbers
750as numbers [perl #57706].
751
752=head3 Negative zero
753
754Negative zero (-0.0), when converted to a string, now becomes "0" on all
755platforms. It used to become "-0" on some, but "0" on others.
756
757If you still need to determine whether a zero is negative, use
758C<sprintf("%g", $zero) =~ /^-/> or the L<Data::Float> module on CPAN.
759
760=head3 C<:=> is now a syntax error
5076a392
FC
761
762Previously C<my $pi := 4;> was exactly equivalent to C<my $pi : = 4;>,
763with the C<:> being treated as the start of an attribute list, ending before
764the C<=>. The use of C<:=> to mean C<: => was deprecated in 5.12.0, and is now
765a syntax error. This will allow the future use of C<:=> as a new token.
766
767We find no Perl 5 code on CPAN using this construction, outside the core's
768tests for it, so we believe that this change will have very little impact on
769real-world codebases.
770
771If it is absolutely necessary to have empty attribute lists (for example,
772because of a code generator) then avoid the error by adding a space before
773the C<=>.
774
61752d82 775=head2 Threads and Processes
5076a392 776
61752d82 777=head3 Directory handles not copied to threads
5076a392 778
61752d82
FC
779On systems other than Windows that do not have
780a C<fchdir> function, newly-created threads no
781longer inherit directory handles from their parent threads. Such programs
782would usually have crashed anyway [perl #75154].
5076a392 783
61752d82 784=head3 C<close> on shared pipes
5076a392 785
61752d82
FC
786The C<close> function no longer waits for the child process to exit if the
787underlying file descriptor is still in use by another thread, to avoid
788deadlocks. It returns true in such cases.
5076a392 789
144b6ea2
FC
790=head3 fork() emulation will not wait for signalled children
791
792On Windows parent processes would not terminate until all forked
793childred had terminated first. However, C<kill('KILL', ...)> is
794inherently unstable on pseudo-processes, and C<kill('TERM', ...)>
795might not get delivered if the child if blocked in a system call.
796
797To avoid the deadlock and still provide a safe mechanism to terminate
798the hosting process, Perl will now no longer wait for children that
799have been sent a SIGTERM signal. It is up to the parent process to
800waitpid() for these children if child clean-up processing must be
801allowed to finish. However, it is also the responsibility of the
802parent then to avoid the deadlock by making sure the child process
803can't be blocked on I/O either.
804
805See L<perlfork> for more information about the fork() emulation on
806Windows.
807
61752d82 808=head2 Configuration
5076a392 809
61752d82 810=head3 Naming fixes in Policy_sh.SH may invalidate Policy.sh
5076a392 811
61752d82
FC
812Several long-standing typos and naming confusions in Policy_sh.SH have
813been fixed, standardizing on the variable names used in config.sh.
5076a392 814
61752d82
FC
815This will change the behavior of Policy.sh if you happen to have been
816accidentally relying on the Policy.sh incorrect behavior.
f318e2e6 817
5a1f7719
FC
818=head3 Perl source code is read in text mode on Windows
819
820Perl scripts used to be read in binary mode on Windows for the benefit
821of the ByteLoader module (which is no longer part of core Perl). This
822had the side effect of breaking various operations on the DATA filehandle,
823including seek()/tell(), and even simply reading from DATA after file handles
824have been flushed by a call to system(), backticks, fork() etc.
825
826The default build options for Windows have been changed to read Perl source
827code on Windows in text mode now. Hopefully ByteLoader will be updated on
828CPAN to automatically handle this situation [perl #28106].
829
5076a392
FC
830=head1 Deprecations
831
1e463951
FC
832See also L</Deprecated C APIs>.
833
5076a392
FC
834=head2 Omitting a space between a regular expression and subsequent word
835
18139a1b
FC
836Omitting a space between a regular expression operator or
837its modifiers and the following word is deprecated. For
838example, C<< m/foo/sand $bar >> will still be parsed
839as C<< m/foo/s and $bar >> but will issue a warning.
5076a392 840
e683df94
KW
841=head2 C<\cI<X>>
842
843The backslash-c construct was designed as a way of specifying
844non-printable characters, but there were no restrictions (on ASCII
845platforms) on what the character following the C<c> could be. Now,
846a deprecation warning is raised if that character isn't an ASCII character.
847Also, a deprecation warning is raised for C<"\c{"> (which is the same
848as simply saying C<";">).
849
4528361d
KW
850=head2 C<"\b{"> and C<"\B{">
851
852In regular expressions, a literal C<"{"> immediately following a C<"\b">
853(not in a bracketed character class) or a C<"\B{"> is now deprecated
854to allow for its future use by Perl itself.
855
5076a392
FC
856=head2 Deprecation warning added for deprecated-in-core .pl libs
857
858This is a mandatory warning, not obeying -X or lexical warning bits.
859The warning is modelled on that supplied by deprecate.pm for
860deprecated-in-core .pm libraries. It points to the specific CPAN
823d0e46
FC
861distribution that contains the .pl libraries. The CPAN version, of
862course, does not generate the warning.
5076a392
FC
863
864=head2 List assignment to C<$[>
865
823d0e46
FC
866Assignment to C<$[> was deprecated and started to give warnings in
867Perl version 5.12.0. This version of perl also starts to emit a warning when
868assigning to C<$[> in list context. This fixes an oversight in 5.12.0.
5076a392
FC
869
870=head2 Use of qw(...) as parentheses
871
872Historically the parser fooled itself into thinking that C<qw(...)> literals
873were always enclosed in parentheses, and as a result you could sometimes omit
874parentheses around them:
875
876 for $x qw(a b c) { ... }
877
878The parser no longer lies to itself in this way. Wrap the list literal in
823d0e46 879parentheses, like this:
5076a392
FC
880
881 for $x (qw(a b c)) { ... }
882
883=head2 C<\N{BELL}> is deprecated
884
885This is because Unicode is using that name for a different character.
886See L</Unicode Version 6.0 is now supported (mostly)> for more
887explanation.
888
889=head2 C<?PATTERN?> is deprecated
890
891C<?PATTERN?> (without the initial m) has been deprecated and now produces
892a warning. This is to allow future use of C<?> in new operators.
893The match-once functionality is still available in the form of C<m?PATTERN?>.
894
5076a392
FC
895=head2 Tie functions on scalars holding typeglobs
896
897Calling a tie function (C<tie>, C<tied>, C<untie>) with a scalar argument
898acts on a file handle if the scalar happens to hold a typeglob.
899
900This is a long-standing bug that will be removed in Perl 5.16, as
901there is currently no way to tie the scalar itself when it holds
902a typeglob, and no way to untie a scalar that has had a typeglob
903assigned to it.
904
823d0e46 905Now there is a deprecation warning whenever a tie
5076a392
FC
906function is used on a handle without an explicit C<*>.
907
18139a1b 908=head2 User-defined case-mapping
5076a392 909
18139a1b
FC
910This feature is being deprecated due to its many issues, as documented in
911L<perlunicode/User-Defined Case Mappings (for serious hackers only)>.
bb5c3f11
KW
912It is planned to remove this feature in Perl 5.16. A CPAN module,
913L<Unicode::Casing>, providing improved functionality is being prepared for
914release by the time 5.14 is available.
823d0e46 915
18139a1b 916=head2 Deprecated modules
5076a392
FC
917
918The following modules will be removed from the core distribution in a
919future release, and should be installed from CPAN instead. Distributions
920on CPAN which require these should add them to their prerequisites. The
823d0e46 921core versions of these modules will issue a deprecation warning.
5076a392
FC
922
923If you ship a packaged version of Perl, either alone or as part of a
924larger system, then you should carefully consider the repercussions of
823d0e46 925core module deprecations. You may want to consider shipping your default
5076a392 926build of Perl with packages for some or all deprecated modules which
823d0e46 927install into C<vendor> or C<site> perl library directories. This will
5076a392
FC
928inhibit the deprecation warnings.
929
930Alternatively, you may want to consider patching F<lib/deprecate.pm>
931to provide deprecation warnings specific to your packaging system
932or distribution of Perl, consistent with how your packaging system
933or distribution manages a staged transition from a release where the
934installation of a single package provides the given functionality, to
935a later release where the system administrator needs to know to install
936multiple packages to get that same functionality.
937
938You can silence these deprecation warnings by installing the modules
939in question from CPAN. To install the latest version of all of them,
940just install C<Task::Deprecations::5_14>.
941
942=over
943
944=item L<Devel::DProf>
945
946We strongly recommend that you install and used L<Devel::NYTProf> in
947preference, as it offers significantly improved profiling and reporting.
948
949=back
950
5076a392
FC
951=head1 Performance Enhancements
952
54c7bb16 953=head2 "Safe signals" optimisation
df91d470
FC
954
955Signal dispatch has been moved from the runloop into control ops. This
956should give a few percent speed increase, and eliminates almost all of
957the speed penalty caused by the introduction of "safe signals" in
9585.8.0. Signals should still be dispatched within the same statement as
959they were previously - if this is not the case, or it is possible to
960create uninterruptible loops, this is a bug, and reports are encouraged
961of how to recreate such issues.
962
54c7bb16 963=head2 Optimisation of shift; and pop; calls without arguments
df91d470 964
111b6aa7
FC
965Two fewer OPs are used for shift and pop calls with no argument (with
966implicit C<@_>). This change makes C<shift;> 5% faster than C<shift @_;>
967on non-threaded perls and 25% faster on threaded.
df91d470 968
fa232254 969=head2 Optimisation of regexp engine string comparison work
df91d470 970
fa232254
FC
971The foldEQ_utf8 API function for case-insensitive comparison of strings (which
972is used heavily by the regexp engine) was substantially refactored and
973optimised - and its documentation much improved as a free bonus gift.
df91d470 974
fa232254 975=head2 Regular expression compilation speed-up
df91d470 976
fa232254
FC
977Compiling regular expressions has been made faster for the case where upgrading
978the regex to utf8 is necessary but that isn't known when the compilation begins.
df91d470 979
fa232254 980=head2 String appending is 100 times faster
df91d470 981
fa232254
FC
982When doing a lot of string appending, perl could end up allocating a lot more
983memory than needed in a very inefficient way, if perl was configured to use the
984system's C<malloc> implementation instead of its own.
985
986C<sv_grow>, which is what's being used to allocate more memory if necessary
987when appending to a string, has now been taught how to round up the memory
988it requests to a certain geometric progression, making it much faster on
989certain platforms and configurations. On Win32, it's now about 100 times
990faster.
991
992=head2 Eliminate C<PL_*> accessor functions under ithreads
993
994When C<MULTIPLICITY> was first developed, and interpreter state moved into
995an interpreter struct, thread and interpreter local C<PL_*> variables were
996defined as macros that called accessor functions, returning the address of
997the value, outside of the perl core. The intent was to allow members
998within the interpreter struct to change size without breaking binary
999compatibility, so that bug fixes could be merged to a maintenance branch
1000that necessitated such a size change.
1001
1002However, some non-core code defines C<PERL_CORE>, sometimes intentionally
1003to bypass this mechanism for speed reasons, sometimes for other reasons but
1004with the inadvertent side effect of bypassing this mechanism. As some of
1005this code is widespread in production use, the result is that the core
1006I<can't> change the size of members of the interpreter struct, as it will
1007break such modules compiled against a previous release on that maintenance
1008branch. The upshot is that this mechanism is redundant, and well-behaved
1009code is penalised by it. Hence it can and should be removed (and has
1010been).
1011
1012=head2 Freeing weak references
1013
1014When an object has many weak references to it, freeing that object
1015can under some some circumstances take O(N^2) time to free (where N is the
1016number of references). The number of circumstances has been reduced
1017[perl #75254]
1018
1019=head2 Lexical array and hash assignments
1020
1021An earlier optimisation to speed up C<my @array = ...> and
1022C<my %hash = ...> assignments caused a bug and was disabled in Perl 5.12.0.
1023
1024Now we have found another way to speed up these assignments [perl #82110].
df91d470 1025
111b6aa7 1026=head2 C<@_> uses less memory
df91d470 1027
111b6aa7
FC
1028Previously, C<@_> was allocated for every subroutine at compile time with
1029enough space for four entries. Now this allocation is done on demand when
1030the subroutine is called [perl #72416].
5076a392 1031
5076a392
FC
1032=head2 Size optimisations to SV and HV structures
1033
1034xhv_fill has been eliminated from struct xpvhv, saving 1 IV per hash and
111b6aa7 1035on some systems will cause struct xpvhv to become cache-aligned. To avoid
5076a392
FC
1036this memory saving causing a slowdown elsewhere, boolean use of HvFILL
1037now calls HvTOTALKEYS instead (which is equivalent) - so while the fill
111b6aa7
FC
1038data when actually required are now calculated on demand, the cases when
1039this needs to be done should be few and far between.
5076a392 1040
111b6aa7
FC
1041The order of structure elements in SV bodies has changed. Effectively,
1042the NV slot has swapped location with STASH and MAGIC. As all access to
1043SV members is via macros, this should be completely transparent. This
5076a392
FC
1044change allows the space saving for PVHVs documented above, and may reduce
1045the memory allocation needed for PVIVs on some architectures.
1046
fa232254
FC
1047C<XPV>, C<XPVIV>, and C<XPVNV> now only allocate the parts of the C<SV> body
1048they actually use, saving some space.
5076a392 1049
fa232254
FC
1050Scalars containing regular expressions now only allocate the part of the C<SV>
1051body they actually use, saving some space.
5076a392
FC
1052
1053=head2 Memory consumption improvements to Exporter
1054
1055The @EXPORT_FAIL AV is no longer created unless required, hence neither is
111b6aa7
FC
1056the typeglob backing it. This saves about 200 bytes for every package that
1057uses Exporter but doesn't use this functionality.
5076a392 1058
111b6aa7 1059=head2 Memory savings for weak references
5076a392
FC
1060
1061For weak references, the common case of just a single weak reference per
1062referent has been optimised to reduce the storage required. In this case it
111b6aa7 1063saves the equivalent of one small Perl array per referent.
5076a392 1064
111b6aa7 1065=head2 C<%+> and C<%-> use less memory
5076a392
FC
1066
1067The bulk of the C<Tie::Hash::NamedCapture> module used to be in the perl
111b6aa7 1068core. It has now been moved to an XS module, to reduce the overhead for
5076a392
FC
1069programs that do not use C<%+> or C<%->.
1070
fa232254 1071=head2 Multiple small improvements to threads
5076a392 1072
fa232254
FC
1073The internal structures of threading now make fewer API calls and fewer
1074allocations, resulting in noticeably smaller object code. Additionally,
1075many thread context checks have been deferred so that they're only done
1076when required (although this is only possible for non-debugging builds).
5076a392 1077
fa232254 1078=head2 Adjacent pairs of nextstate opcodes are now optimized away
5076a392 1079
fa232254 1080Previously, in code such as
5076a392 1081
fa232254 1082 use constant DEBUG => 0;
5076a392 1083
fa232254
FC
1084 sub GAK {
1085 warn if DEBUG;
1086 print "stuff\n";
1087 }
5076a392 1088
fa232254
FC
1089the ops for C<warn if DEBUG;> would be folded to a C<null> op (C<ex-const>), but
1090the C<nextstate> op would remain, resulting in a runtime op dispatch of
1091C<nextstate>, C<nextstate>, ....
5076a392 1092
fa232254
FC
1093The execution of a sequence of C<nextstate> ops is indistinguishable from just
1094the last C<nextstate> op so the peephole optimizer now eliminates the first of
1095a pair of C<nextstate> ops, except where the first carries a label, since labels
1096must not be eliminated by the optimizer and label usage isn't conclusively known
1097at compile time.
5076a392
FC
1098
1099=head1 Modules and Pragmata
1100
1101=head2 New Modules and Pragmata
1102
1103=over 4
1104
1105=item *
1106
1107C<CPAN::Meta::YAML> 0.003 has been added as a dual-life module. It supports a
1108subset of YAML sufficient for reading and writing META.yml and MYMETA.yml files
1109included with CPAN distributions or generated by the module installation
1110toolchain. It should not be used for any other general YAML parsing or
1111generation task.
1112
1113=item *
1114
1115C<CPAN::Meta> version 2.110440 has been added as a dual-life module. It
1116provides a standard library to read, interpret and write CPAN distribution
1117metadata files (e.g. META.json and META.yml) which describes a
1118distribution, its contents, and the requirements for building it and
1119installing it. The latest CPAN distribution metadata specification is
1120included as C<CPAN::Meta::Spec> and notes on changes in the specification
1121over time are given in C<CPAN::Meta::History>.
1122
1123=item *
1124
5a553547 1125C<HTTP::Tiny> 0.011 has been added as a dual-life module. It is a very
5076a392
FC
1126small, simple HTTP/1.1 client designed for simple GET requests and file
1127mirroring. It has has been added to enable CPAN.pm and CPANPLUS to
1128"bootstrap" HTTP access to CPAN using pure Perl without relying on external
1129binaries like F<curl> or F<wget>.
1130
1131=item *
1132
1133C<JSON::PP> 2.27105 has been added as a dual-life module, for the sake of
1134reading F<META.json> files in CPAN distributions.
1135
1136=item *
1137
1138C<Module::Metadata> 1.000003 has been added as a dual-life module. It gathers
1139package and POD information from Perl module files. It is a standalone module
1140based on Module::Build::ModuleInfo for use by other module installation
1141toolchain components. Module::Build::ModuleInfo has been deprecated in
1142favor of this module instead.
1143
1144=item *
1145
1146C<Perl::OSType> 1.002 has been added as a dual-life module. It maps Perl
1147operating system names (e.g. 'dragonfly' or 'MSWin32') to more generic types
1148with standardized names (e.g. "Unix" or "Windows"). It has been refactored
1149out of Module::Build and ExtUtils::CBuilder and consolidates such mappings into
1150a single location for easier maintenance.
1151
1152=item *
1153
1154The following modules were added by the C<Unicode::Collate>
1155upgrade. See below for details.
1156
1157C<Unicode::Collate::CJK::Big5>
1158
1159C<Unicode::Collate::CJK::GB2312>
1160
1161C<Unicode::Collate::CJK::JISX0208>
1162
1163C<Unicode::Collate::CJK::Korean>
1164
1165C<Unicode::Collate::CJK::Pinyin>
1166
1167C<Unicode::Collate::CJK::Stroke>
1168
1169=item *
1170
1171C<Version::Requirements> version 0.101020 has been added as a dual-life
1172module. It provides a standard library to model and manipulates module
1173prerequisites and version constraints as defined in the L<CPAN::Meta::Spec>.
1174
1175=back
1176
d622514a 1177=head2 Selected Module and Pragma Updates
5076a392
FC
1178
1179=over 4
1180
1181=item *
1182
5076a392
FC
1183C<Archive::Extract> has been upgraded from version 0.38 to 0.48.
1184
1185Updates since 0.38 include: a safe print method that guards
1186Archive::Extract from changes to $\; a fix to the tests when run in core
1984204c
FC
1187perl; support for TZ files; a modification for the lzma
1188logic to favour IO::Uncompress::Unlzma; and a fix
1189for an issue with NetBSD-current and its new unzip
5076a392
FC
1190executable.
1191
1192=item *
1193
1194C<Archive::Tar> has been upgraded from version 1.54 to 1.76.
1195
1984204c
FC
1196Important changes since 1.54 include the following:
1197
1198=over
1199
1200=item *
1201
1202Compatibility with busybox implementations of tar
1203
1204=item *
1205
1206A fix so that C<write()> and C<create_archive()>
1207close only handles they opened
1208
1209=item *
1210
1211A bug was fixed regarding the exit code of extract_archive.
5076a392 1212
1984204c
FC
1213=item *
1214
1215C<ptar> has a new option to allow safe
5076a392
FC
1216creation of tarballs without world-writable files on Windows, allowing those
1217archives to be uploaded to CPAN.
1218
1984204c
FC
1219=item *
1220
1221A new ptargrep utility for using regular expressions against
5076a392
FC
1222the contents of files in a tar archive.
1223
1984204c
FC
1224=item *
1225
1226Pax extended headers are now skipped.
1227
1228=back
5076a392
FC
1229
1230=item *
1231
5076a392
FC
1232C<B> has been upgraded from version 1.23 to 1.27.
1233
1234It no longer crashes when taking apart a C<y///> containing characters
1235outside the octet range or compiled in a C<use utf8> scope.
1236
1237The size of the shared object has been reduced by about 40%, with no
1238reduction in functionality.
1239
1240=item *
1241
1242C<B::Concise> has been upgraded from version 0.78 to 0.82.
1243
1244B::Concise marks rv2sv, rv2av and rv2hv ops with the new OPpDEREF flag
1245as "DREFed".
1246
1247It no longer produces mangled output with the C<-tree> option
1248[perl #80632].
1249
1250=item *
1251
5076a392
FC
1252C<B::Deparse> has been upgraded from version 0.96 to 1.02.
1253
1984204c 1254The deparsing of a nextstate op has changed when it has both a
5076a392
FC
1255change of package (relative to the previous nextstate), or a change of
1256C<%^H> or other state, and a label. Previously the label was emitted
cdc10f43 1257first, but now the label is emitted last (5.12.1).
5076a392 1258
5a553547
FC
1259The C<no 5.13.2> or similar form is now correctly handled by B::Deparse
1260(5.12.3).
5076a392
FC
1261
1262B::Deparse now properly handles the code that applies a conditional
1263pattern match against implicit C<$_> as it was fixed in [perl #20444].
1264
1984204c
FC
1265Deparsing of C<our> followed by a variable with funny characters
1266(as permitted under the C<utf8> pragma) has also been fixed [perl #33752].
5076a392
FC
1267
1268=item *
1269
d430b8e7 1270C<Carp> has been upgraded from version 1.15 to 1.19.
5076a392
FC
1271
1272L<Carp> now detects incomplete L<caller()|perlfunc/"caller EXPR"> overrides and
d430b8e7
FC
1273avoids using bogus C<@DB::args>. To provide backtraces,
1274Carp relies on particular behaviour of the C<caller>
1275built-in. Carp now detects if other code has
5076a392 1276overridden this with an incomplete implementation, and modifies its backtrace
d430b8e7
FC
1277accordingly. Previously incomplete overrides would cause incorrect values
1278in backtraces (best case), or obscure fatal errors (worst case).
5076a392
FC
1279
1280This fixes certain cases of C<Bizarre copy of ARRAY> caused by modules
d430b8e7 1281overriding C<caller()> incorrectly (5.12.2).
5076a392 1282
1984204c 1283It now also avoids using regular expressions that cause perl to
5076a392
FC
1284load its Unicode tables, in order to avoid the 'BEGIN not safe after
1285errors' error that will ensue if there has been a syntax error
1286[perl #82854].
1287
1288=item *
1289
1290C<CGI> has been upgraded from version 3.48 to 3.51.
1291
1292This provides the following security fixes: the MIME boundary in
1984204c
FC
1293multipart_init is now random and the handling of
1294newlines embedded in header values has been improved.
5076a392
FC
1295
1296=item *
1297
5076a392
FC
1298C<Compress::Raw::Bzip2> has been upgraded from version 2.024 to 2.033.
1299
1984204c 1300It has been updated to use bzip2 1.0.6.
5076a392
FC
1301
1302=item *
1303
1984204c
FC
1304C<CPAN> has been upgraded from version 1.94_56 to 1.9600.-
1305
1306Major highlights:
5076a392
FC
1307
1308=over 4
1309
1984204c 1310=item * much less configuration dialog hassle
5076a392 1311
1984204c 1312=item * support for META/MYMETA.json
5076a392 1313
1984204c 1314=item * support for local::lib
5076a392 1315
1984204c 1316=item * support for HTTP::Tiny to reduce the dependency on ftp sites
5076a392 1317
1984204c 1318=item * automatic mirror selection
5076a392 1319
1984204c 1320=item * iron out all known bugs in configure_requires
5076a392 1321
1984204c
FC
1322=item * support for distributions compressed with bzip2
1323
1324=item * allow Foo/Bar.pm on the commandline to mean Foo::Bar
1325
1326=back
5076a392
FC
1327
1328=item *
1329
d430b8e7
FC
1330C<CPANPLUS> has been upgraded from version 0.90 to 0.9103.
1331
1332A change to F<cpanp-run-perl>
1333resolves L<RT #55964|http://rt.cpan.org/Public/Bug/Display.html?id=55964>
1334and L<RT #57106|http://rt.cpan.org/Public/Bug/Display.html?id=57106>, both
1335of which related to failures to install distributions that use
1336C<Module::Install::DSL> (5.12.2).
5076a392 1337
1984204c
FC
1338A dependency on Config was not recognised as a
1339core module dependency. This has been fixed.
5076a392 1340
1984204c 1341CPANPLUS now includes support for META.json and MYMETA.json.
5076a392
FC
1342
1343=item *
1344
5076a392
FC
1345C<Data::Dumper> has been upgraded from version 2.125 to 2.130_02.
1346
4ed2cea4
FC
1347The indentation used to be off when C<$Data::Dumper::Terse> was set. This
1348has been fixed [perl #73604].
1349
1984204c
FC
1350This upgrade also fixes a crash when using custom sort functions that might
1351cause the stack to change [perl #74170].
5076a392
FC
1352
1353C<Dumpxs> no longer crashes with globs returned by C<*$io_ref>
1354[perl #72332].
1355
1356=item *
1357
5076a392
FC
1358C<Devel::DProf> has been upgraded from version 20080331.00 to 20110228.00.
1359
1360Merely loading C<Devel::DProf> now no longer triggers profiling to start.
1361C<use Devel::DProf> and C<perl -d:DProf ...> still behave as before and start
1362the profiler.
1363
1364NOTE: C<Devel::DProf> is deprecated and will be removed from a future
1984204c 1365version of Perl. We strongly recommend that you install and use
5076a392
FC
1366L<Devel::NYTProf> instead, as it offers significantly improved
1367profiling and reporting.
1368
1369=item *
1370
5076a392
FC
1371C<diagnostics> has been upgraded from version 1.19 to 1.22.
1372
1373It now renders pod links slightly better, and has been taught to find
1374descriptions for messages that share their descriptions with other
1375messages.
1376
1377=item *
1378
1379C<Digest::MD5> has been upgraded from version 2.39 to 2.51.
1380
1381It is now safe to use this module in combination with threads.
1382
1383=item *
1384
1385C<Digest::SHA> has been upgraded from version 5.47 to 5.61.
1386
1387C<shasum> now more closely mimics C<sha1sum>/C<md5sum>.
1388
1389C<Addfile> accepts all POSIX filenames.
1390
1984204c
FC
1391New SHA-512/224 and SHA-512/256 transforms (ref. NIST Draft FIPS 180-4
1392[February 2011])
5076a392
FC
1393
1394=item *
1395
5076a392
FC
1396C<DynaLoader> has been upgraded from version 1.10 to 1.12.
1397
1398It fixes a buffer overflow when passed a very long file name.
1399
1400It no longer inherits from AutoLoader; hence it no longer
1401produces weird error messages for unsuccessful method calls on classes that
1402inherit from DynaLoader [perl #84358].
1403
1404=item *
1405
1406C<Encode> has been upgraded from version 2.39 to 2.42.
1407
1408Now, all 66 Unicode non-characters are treated the same way U+FFFF has
1984204c
FC
1409always been treated; in cases when it was disallowed, all 66 are
1410disallowed; in those cases where it warned, all 66 warn.
5076a392
FC
1411
1412=item *
1413
5076a392
FC
1414C<Errno> has been upgraded from version 1.11 to 1.13.
1415
1416The implementation of C<Errno> has been refactored to use about 55% less memory.
5076a392
FC
1417
1418On some platforms with unusual header files, like Win32/gcc using mingw64
1419headers, some constants which weren't actually error numbers have been exposed
1420by C<Errno>. This has been fixed [perl #77416].
1421
1422=item *
1423
1424C<Exporter> has been upgraded from version 5.64_01 to 5.64_03.
1425
1426Exporter no longer overrides C<$SIG{__WARN__}> [perl #74472]
1427
1428=item *
1429
5076a392
FC
1430C<ExtUtils::Constant> has been upgraded from 0.22 to 0.23.
1431
1432The C<AUTOLOAD> helper code generated by C<ExtUtils::Constant::ProxySubs>
1433can now C<croak> for missing constants, or generate a complete C<AUTOLOAD>
1984204c
FC
1434subroutine in XS, allowing simplification of many modules that use it
1435(C<Fcntl>, C<File::Glob>, C<GDBM_File>, C<I18N::Langinfo>, C<POSIX>,
1436C<Socket>).
5076a392
FC
1437
1438C<ExtUtils::Constant::ProxySubs> can now optionally push the names of all
1984204c 1439constants onto the package's C<@EXPORT_OK>.
5076a392
FC
1440
1441=item *
1442
5076a392
FC
1443C<File::DosGlob> has been upgraded from version 1.01 to 1.03.
1444
1445It allows patterns containing literal parentheses (they no longer need to
1984204c
FC
1446be escaped). On Windows, it no longer
1447adds an extra F<./> to the file names
5076a392
FC
1448returned when the pattern is a relative glob with a drive specification,
1449like F<c:*.pl> [perl #71712].
1450
1451=item *
1452
1453C<File::Fetch> has been upgraded from version 0.24 to 0.32.
1454
1455C<HTTP::Lite> is now supported for 'http' scheme.
1456
1457The C<fetch> utility is supported on FreeBSD, NetBSD and
1458Dragonfly BSD for the C<http> and C<ftp> schemes.
1459
1460=item *
1461
1462C<File::Find> has been upgraded from version 1.15 to 1.18.
1463
1984204c 1464It improves handling of backslashes on Windows, so that paths like
5076a392
FC
1465F<c:\dir\/file> are no longer generated [perl #71710].
1466
1467=item *
1468
d430b8e7
FC
1469C<File::Spec> has been upgraded from version 3.31 to 3.33.
1470
1471Several portability fixes were made in C<File::Spec::VMS>: a colon is now
1472recognized as a delimiter in native filespecs; caret-escaped delimiters are
1473recognized for better handling of extended filespecs; C<catpath()> returns
1474an empty directory rather than the current directory if the input directory
1475name is empty; C<abs2rel()> properly handles Unix-style input (5.12.2).
1476
1477=item *
1478
5076a392
FC
1479C<File::stat> has been upgraded from 1.02 to 1.04.
1480
1481The C<-x> and C<-X> file test operators now work correctly under the root
1482user.
1483
1484=item *
1485
5076a392
FC
1486C<GDBM_File> has been upgraded from 1.10 to 1.13.
1487
1488This fixes a memory leak when DBM filters are used.
1489
1490=item *
1491
1492C<Hash::Util> has been upgraded from 0.07 to 0.10.
1493
1984204c
FC
1494Hash::Util no longer emits spurious "uninitialized" warnings when
1495recursively locking hashes that have undefined values [perl #74280].
5076a392
FC
1496
1497=item *
1498
1499C<I18N::Langinfo> has been upgraded from version 0.03 to 0.07.
1500
1501C<langinfo()> now defaults to using C<$_> if there is no argument given, just
5334145a 1502as the documentation has always claimed.
5076a392
FC
1503
1504=item *
1505
1506C<IO::Select> has been upgraded from version 1.17 to 1.18.
1507
1508It now allows IO::Handle objects (and objects in derived classes) to be
1509removed from an IO::Select set even if the underlying file descriptor is
1510closed or invalid.
1511
1512=item *
1513
5076a392
FC
1514C<IPC::Cmd> has been upgraded from version 0.54 to 0.68.
1515
1984204c
FC
1516Resolves an issue with splitting Win32 command lines. An argument
1517consisting of the single character "0" used to be omitted (CPAN RT #62961).
5076a392
FC
1518
1519=item *
1520
1521C<IPC::Open3> has been upgraded from 1.05 to 1.08.
1522
4ed2cea4
FC
1523C<open3> now produces an error if the C<exec> call fails, allowing this
1524condition to be distinguished from a child process that exited with a
1525non-zero status [perl #72016].
1526
5076a392
FC
1527The internal C<xclose> routine now knows how to handle file descriptors, as
1528documented, so duplicating STDIN in a child process using its file
1529descriptor now works [perl #76474].
1530
1531=item *
1532
5076a392
FC
1533C<Locale::Maketext> has been upgraded from version 1.14 to 1.17.
1534
1984204c 1535Locale::Maketext now supports external caches.
5076a392 1536
1984204c
FC
1537This upgrade also fixes an infinite loop in
1538C<Locale::Maketext::Guts::_compile()> when
5076a392
FC
1539working with tainted values (CPAN RT #40727).
1540
1984204c 1541C<< ->maketext >> calls will now back up and restore C<$@> so that error
5076a392
FC
1542messages are not suppressed (CPAN RT #34182).
1543
1544=item *
1545
5076a392
FC
1546C<Math::BigInt> has been upgraded from version 1.89_01 to 1.994.
1547
1548This fixes, among other things, incorrect results when computing binomial
1549coefficients [perl #77640].
1550
1984204c 1551It also prevents C<sqrt($int)> from crashing under C<use bigrat;>
5076a392
FC
1552[perl #73534].
1553
1554=item *
1555
5076a392
FC
1556C<MIME::Base64> has been upgraded from 3.08 to 3.13.
1557
1558Includes new functions to calculate the length of encoded and decoded
1559base64 strings.
1560
1561Now provides C<encode_base64url> and C<decode_base64url> functions to process
1562the base64 scheme for "URL applications".
1563
1564=item *
1565
1566C<Module::Build> has been upgraded from version 0.3603 to 0.3800.
1567
1568A notable change is the deprecation of several modules.
1569Module::Build::Version has been deprecated and Module::Build now relies
1570directly upon L<version>. Module::Build::ModuleInfo has been deprecated in
1571favor of a standalone copy of it called L<Module::Metadata>.
1572Module::Build::YAML has been deprecated in favor of L<CPAN::Meta::YAML>.
1573
1574Module::Build now also generates META.json and MYMETA.json files
1575in accordance with version 2 of the CPAN distribution metadata specification,
1576L<CPAN::Meta::Spec>. The older format META.yml and MYMETA.yml files are
1577still generated, as well.
1578
1579=item *
1580
1581C<Module::CoreList> has been upgraded from version 2.29 to XXX.
1582
1583Besides listing the updated core modules of this release, it also stops listing
1984204c 1584the C<Filespec> module. That module never existed in core. The scripts
5076a392 1585generating C<Module::CoreList> confused it with C<VMS::Filespec>, which actually
1984204c 1586is a core module as of perl 5.8.7.
5076a392
FC
1587
1588=item *
1589
1984204c
FC
1590C<NDBM_File> and C<ODBM_File> have been upgraded from 1.08 to 1.11, and
1591from 1.08 to 1.09, respectively.
5076a392
FC
1592
1593This fixes a memory leak when DBM filters are used.
1594
1595=item *
1596
5076a392
FC
1597C<overload> has been upgraded from 1.11 to 1.12.
1598
1599C<overload::Method> can now handle subroutines that are themselves blessed
1600into overloaded classes [perl #71998].
1601
5076a392
FC
1602The documentation has greatly improved. See L</Documentation> below.
1603
1604=item *
1605
5076a392
FC
1606C<Parse::CPAN::Meta> has been upgraded from version 1.40 to 1.4401.
1607
1984204c 1608The latest Parse::CPAN::Meta can now read YAML and JSON files using
5076a392
FC
1609L<CPAN::Meta::YAML> and L<JSON::PP>, which are now part of the Perl core.
1610
1611=item *
1612
5076a392
FC
1613C<PerlIO::scalar> has been upgraded from 0.07 to 0.11.
1614
1615A C<read> after a C<seek> beyond the end of the string no longer thinks it
1616has data to read [perl #78716].
1617
1618=item *
1619
5076a392
FC
1620C<POSIX> has been upgraded from 1.19 to 1.23.
1621
1622It now includes constants for POSIX signal constants.
1623
1624=item *
1625
1984204c 1626C<re> has been upgraded from version 0.11 to 0.17.
5076a392
FC
1627
1628New C<use re "/flags"> pragma
1629
5076a392 1630The C<regmust> function used to crash when called on a regular expression
1984204c 1631belonging to a pluggable engine. Now it croaks instead.
5076a392
FC
1632
1633C<regmust> no longer leaks memory.
1634
1635=item *
1636
1637C<Safe> has been upgraded from version 2.25 to 2.29.
1638
cdc10f43
FC
1639Coderefs returned by C<reval()> and C<rdo()> are now wrapped via
1640C<wrap_code_refs> (5.12.1).
1641
5076a392
FC
1642This fixes a possible infinite loop when looking for coderefs.
1643
cdc10f43 1644It adds several version::vxs::* routines to the default share.
5076a392
FC
1645
1646=item *
1647
5076a392
FC
1648C<SelfLoader> has been upgraded from 1.17 to 1.18.
1649
1650It now works in taint mode [perl #72062].
1651
1652=item *
1653
1654C<sigtrap> has been upgraded from version 1.04 to 1.05.
1655
1656It no longer tries to modify read-only arguments when generating a
1657backtrace [perl #72340].
1658
1659=item *
1660
1984204c 1661C<Socket> has been upgraded from version 1.87 to 1.94.
5076a392 1662
1984204c 1663See L</IPv6 support>, above.
5076a392
FC
1664
1665=item *
1666
1667C<Storable> has been upgraded from version 2.22 to 2.27.
1668
1669Includes performance improvement for overloaded classes.
1670
5076a392 1671This adds support for serialising code references that contain UTF-8 strings
1984204c
FC
1672correctly. The Storable minor version
1673number changed as a result, meaning that
5076a392
FC
1674Storable users who set C<$Storable::accept_future_minor> to a C<FALSE> value
1675will see errors (see L<Storable/FORWARD COMPATIBILITY> for more details).
1676
1677Freezing no longer gets confused if the Perl stack gets reallocated
1678during freezing [perl #80074].
1679
1680=item *
1681
5076a392
FC
1682C<Test::Simple> has been upgraded from version 0.94 to 0.98.
1683
1684Among many other things, subtests without a C<plan> or C<no_plan> now have an
1685implicit C<done_testing()> added to them.
1686
1687=item *
1688
5076a392
FC
1689C<Thread::Semaphore> has been upgraded from version 2.09 to 2.12.
1690
1984204c
FC
1691It provides two new methods that give more control over the decrementing of
1692semaphores: C<down_nb> and C<down_force>.
5076a392
FC
1693
1694=item *
1695
5076a392
FC
1696C<Tie::Hash> has been upgraded from version 1.03 to 1.04.
1697
1698Calling C<< Tie::Hash-E<gt>TIEHASH() >> used to loop forever. Now it C<croak>s.
1699
1700=item *
1701
5076a392
FC
1702C<Unicode::Collate> has been upgraded from version 0.52_01 to 0.73.
1703
1984204c 1704Unicode::Collate has been updated to use Unicode 6.0.0.
5076a392 1705
1984204c
FC
1706Unicode::Collate::Locale now supports a plethora of new locales: ar, be,
1707bg, de__phonebook, hu, hy, kk, mk, nso, om, tn, vi, hr, ig, ja, ko, ru, sq,
1708se, sr, to, uk, zh, zh__big5han, zh__gb2312han, zh__pinyin and zh__stroke.
5076a392
FC
1709
1710The following modules have been added:
1711
1712C<Unicode::Collate::CJK::Big5> for C<zh__big5han> which makes
1713tailoring of CJK Unified Ideographs in the order of CLDR's big5han ordering.
1714
1715C<Unicode::Collate::CJK::GB2312> for C<zh__gb2312han> which makes
1716tailoring of CJK Unified Ideographs in the order of CLDR's gb2312han ordering.
1717
1718C<Unicode::Collate::CJK::JISX0208> which makes tailoring of 6355 kanji
1719(CJK Unified Ideographs) in the JIS X 0208 order.
1720
1721C<Unicode::Collate::CJK::Korean> which makes tailoring of CJK Unified Ideographs
1722in the order of CLDR's Korean ordering.
1723
1724C<Unicode::Collate::CJK::Pinyin> for C<zh__pinyin> which makes
1725tailoring of CJK Unified Ideographs in the order of CLDR's pinyin ordering.
1726
1727C<Unicode::Collate::CJK::Stroke> for C<zh__stroke> which makes
1728tailoring of CJK Unified Ideographs in the order of CLDR's stroke ordering.
1729
5076a392
FC
1730This also sees the switch from using the pure-perl version of this
1731module to the XS version.
1732
1733=item *
1734
5076a392
FC
1735C<Unicode::UCD> has been upgraded from version 0.27 to 0.32.
1736
1984204c
FC
1737A new function, C<Unicode::UCD::num()>, has been added. This function
1738returns the numeric value of the string passed it or C<undef> if the string
1739in its entirety has no "safe" numeric value. (For more detail, and for the
1740definition of "safe", see L<Unicode::UCD/num>.)
5076a392 1741
1984204c 1742This upgrade also includes a number of bug fixes:
5076a392
FC
1743
1744=over 4
1745
1746=item charinfo()
1747
1748=over 4
1749
1750=item *
1751
1752It is now updated to Unicode Version 6 with Corrigendum #8, except,
1753as with Perl 5.14, the code point at U+1F514 has no name.
1754
1755=item *
1756
1757The Hangul syllable code points have the correct names, and their
1758decompositions are always output without requiring L<Lingua::KO::Hangul::Util>
1759to be installed.
1760
1761=item *
1762
54c7bb16
FC
1763The CJK (Chinese-Japanese-Korean) code points U+2A700 to U+2B734
1764and U+2B740 to U+2B81D are now properly handled.
5076a392
FC
1765
1766=item *
1767
1768The numeric values are now output for those CJK code points that have them.
1769
1770=item *
1771
1772The names that are output for code points with multiple aliases are now the
1773corrected ones.
1774
1775=back
1776
1777=item charscript()
1778
1779This now correctly returns "Unknown" instead of C<undef> for the script
1780of a code point that hasn't been assigned another one.
1781
1782=item charblock()
1783
1784This now correctly returns "No_Block" instead of C<undef> for the block
1785of a code point that hasn't been assigned to another one.
1786
1787=back
1788
5076a392
FC
1789=item *
1790
1791C<version> has been upgraded from 0.82 to 0.88.
1792
1984204c 1793Due to a bug, now fixed, the C<is_strict> and C<is_lax> functions did not
cdc10f43 1794work when exported (5.12.1).
5076a392
FC
1795
1796=item *
1797
1798C<warnings> and C<warnings::register> have been upgraded from version 1.09
1799to 1.11 and from version 1.01 to 1.02 respectively.
1800
1801Calling C<use warnings> without arguments is now significantly more efficient.
1802
1803It is now possible to register warning categories other than the names of
1804packages using C<warnings::register>. See L<perllexwarn> for more information.
1805
1806=item *
1807
1808C<VMS::DCLsym> has been upgraded from version 1.03 to 1.05.
1809
1810Two bugs have been fixed [perl #84086]:
1811
1812The symbol table name was lost when tying a hash, due to a thinko in
1813C<TIEHASH>. The result was that all tied hashes interacted with the
1814local symbol table.
1815
1816Unless a symbol table name had been explicitly specified in the call
1817to the constructor, querying the special key ':LOCAL' failed to
1818identify objects connected to the local symbol table.
1819
1820=item *
1821
1822C<Win32> has been upgraded from version 0.39 to 0.44.
1823
1984204c
FC
1824This release has several new functions: C<Win32::GetSystemMetrics>,
1825C<Win32::GetProductInfo>, C<Win32::GetOSDisplayName>.
5076a392 1826
1984204c
FC
1827The names returned by C<Win32::GetOSName> and C<Win32::GetOSDisplayName>
1828have been corrected.
5076a392 1829
5076a392
FC
1830=back
1831
5076a392
FC
1832=head2 Removed Modules and Pragmata
1833
1834The following modules have been removed from the core distribution, and if
1835needed should be installed from CPAN instead.
1836
1837=over
1838
1839=item C<Class::ISA>
1840
1841=item C<Pod::Plainer>
1842
1843=item C<Switch>
1844
1845=back
1846
1847The removal of C<Shell> has been deferred until after 5.14, as the
1848implementation of C<Shell> shipped with 5.12.0 did not correctly issue the
1849warning that it was to be removed from core.
1850
1851=head1 Documentation
1852
5076a392
FC
1853=head2 New Documentation
1854
41e29def 1855=head3 L<perlgpl>
5076a392
FC
1856
1857L<perlgpl> has been updated to contain GPL version 1, as is included in the
cdc10f43 1858F<README> distributed with perl (5.12.1).
5076a392 1859
41e29def 1860=head3 Perl 5.12.x delta files
5076a392 1861
41e29def
FC
1862The perldelta files for Perl 5.12.1 to 5.12.3 have been added from the
1863maintenance branch: L<perl5121delta>, L<perl5122delta>, L<perl5123delta>.
5076a392
FC
1864
1865=head3 L<perlpodstyle>
1866
1867New style guide for POD documentation,
1868split mostly from the NOTES section of the pod2man man page.
1869
41e29def
FC
1870=head3 L<perlsource>, L<perlinterp>, L<perlhacktut>, and L<perlhacktips>
1871
1872See L</L<perlhack> and perlrepository revamp>, below.
5076a392
FC
1873
1874=head2 Changes to Existing Documentation
1875
41e29def 1876=head3 L<perlmodlib> is now complete
4ed2cea4
FC
1877
1878The perlmodlib page that came with Perl 5.12.0 was missing a lot of
1879modules, due to a bug in the script that generates the list. This has been
cdc10f43 1880fixed [perl #74332] (5.12.1).
4ed2cea4 1881
41e29def 1882=head3 Replace wrong tr/// table in L<perlebcdic>
5076a392 1883
41e29def 1884L<perlebcdic> contains a helpful table to use in tr/// to convert
5076a392
FC
1885between EBCDIC and Latin1/ASCII. Unfortunately, the table was the
1886inverse of the one it describes, though the code that used the table
1887worked correctly for the specific example given.
1888
1889The table has been changed to its inverse, and the sample code changed
1890to correspond, as this is easier for the person trying to follow the
1891instructions since deriving the old table is somewhat more complicated.
1892
1893The table has also been changed to hex from octal, as that is more the norm
1894these days, and the recipes in the pod altered to print out leading
41e29def 1895zeros to make all the values the same length.
5076a392 1896
41e29def 1897=head3 Tricks for user-defined casing
5076a392 1898
41e29def
FC
1899L<perlunicode> now contains an explanation of how to override, mangle
1900and otherwise tweak the way perl handles upper-, lower- and other-case
1901conversions on Unicode data, and how to provide scoped changes to alter
1902one's own code's behaviour without stomping on anybody else.
5076a392
FC
1903
1904=head3 INSTALL explicitly states the requirement for C89
1905
d430b8e7
FC
1906This was already true but it's now Officially Stated For The Record
1907(5.12.2).
5076a392 1908
41e29def 1909=head3 Explanation of C<\xI<HH>> and C<\oI<OOO>> escapes
5076a392 1910
41e29def
FC
1911L<perlop> has been updated with more detailed explanation of these two
1912character escapes.
5076a392 1913
41e29def 1914=head3 C<-0I<NNN>> switch
5076a392 1915
41e29def 1916In L<perlrun>, the behavior of the C<-0NNN> switch for C<-0400> or higher
d430b8e7 1917has been clarified (5.12.2).
5076a392 1918
cdc10f43
FC
1919=head3 Maintenance policy
1920
1921L<perlpolicy> now contains the policy on what patches are acceptable for
1922maintenance branches (5.12.1).
1923
41e29def 1924=head3 Deprecation policy
5076a392 1925
41e29def 1926L<perlpolicy> now contains the policy on compatibility and deprecation
d430b8e7 1927along with definitions of terms like "deprecation" (5.12.2).
5076a392 1928
41e29def 1929=head3 New descriptions in L<perldiag>
5076a392
FC
1930
1931The following existing diagnostics are now documented:
1932
1933=over 4
1934
1935=item *
1936
1937L<Ambiguous use of %c resolved as operator %c|perldiag/"Ambiguous use of %c resolved as operator %c">
1938
1939=item *
1940
1941L<Ambiguous use of %c{%s} resolved to %c%s|perldiag/"Ambiguous use of %c{%s} resolved to %c%s">
1942
1943=item *
1944
1945L<Ambiguous use of %c{%s%s} resolved to %c%s%s|perldiag/"Ambiguous use of %c{%s%s} resolved to %c%s%s">
1946
1947=item *
1948
1949L<Ambiguous use of -%s resolved as -&%s()|perldiag/"Ambiguous use of -%s resolved as -&%s()">
1950
1951=item *
1952
1953L<Invalid strict version format (%s)|perldiag/"Invalid strict version format (%s)">
1954
1955=item *
1956
1957L<Invalid version format (%s)|perldiag/"Invalid version format (%s)">
1958
1959=item *
1960
1961L<Invalid version object|perldiag/"Invalid version object">
1962
1963=back
1964
5076a392
FC
1965=head3 L<perlbook>
1966
41e29def 1967L<perlbook> has been expanded to cover many more popular books.
5076a392 1968
41e29def 1969=head3 C<SvTRUE> macro
5076a392 1970
41e29def
FC
1971The documentation for the C<SvTRUE> macro in
1972L<perlapi> was simply wrong in stating that
5076a392
FC
1973get-magic is not processed. It has been corrected.
1974
41e29def 1975=head3 L<perlvar> revamp
5076a392 1976
41e29def 1977L<perlvar> reorders the variables and groups them by topic. Each variable
5076a392 1978introduced after Perl 5.000 notes the first version in which it is
41e29def 1979available. L<perlvar> also has a new section for deprecated variables to
5076a392
FC
1980note when they were removed.
1981
41e29def 1982=head3 Array and hash slices in scalar context
5076a392 1983
41e29def 1984These are now documented in L<perldata>.
5076a392 1985
41e29def 1986=head3 C<use locale> and formats
5076a392
FC
1987
1988L<perlform> and L<perllocale> have been corrected to state that
1989C<use locale> affects formats.
1990
5076a392
FC
1991=head3 L<overload>
1992
5076a392
FC
1993L<overload>'s documentation has practically undergone a rewrite. It
1994is now much more straightforward and clear.
1995
41e29def 1996=head3 L<perlhack> and perlrepository revamp
5076a392
FC
1997
1998The L<perlhack> and perlrepository documents have been heavily edited and
1999split up into several new documents.
2000
2001The L<perlhack> document is now much shorter, and focuses on the Perl 5
2002development process and submitting patches to Perl. The technical content has
2003been moved to several new documents, L<perlsource>, L<perlinterp>,
2004L<perlhacktut>, and L<perlhacktips>. This technical content has only been
2005lightly edited.
2006
2007The perlrepository document has been renamed to L<perlgit>. This new document
2008is just a how-to on using git with the Perl source code. Any other content
2009that used to be in perlrepository has been moved to perlhack.
2010
41e29def 2011=head3 Time::Piece examples
5076a392
FC
2012
2013Examples in L<perlfaq4> have been updated to show the use of
41e29def 2014L<Time::Piece>.
5076a392
FC
2015
2016=head1 Diagnostics
2017
2018The following additions or changes have been made to diagnostic output,
2019including warnings and fatal error messages. For the complete list of
2020diagnostic messages, see L<perldiag>.
2021
2022=head2 New Diagnostics
2023
a593b319
FC
2024=head3 New Errors
2025
5076a392
FC
2026=over
2027
a593b319 2028=item Closure prototype called
5076a392 2029
a593b319
FC
2030This error occurs when a subroutine reference passed to an attribute
2031handler is called, if the subroutine is a closure [perl #68560].
5076a392 2032
a593b319 2033=item Insecure user-defined property %s
5076a392 2034
a593b319
FC
2035Perl detected tainted data when trying to compile a regular
2036expression that contains a call to a user-defined character property
2037function, i.e. C<\p{IsFoo}> or C<\p{InFoo}>.
2038See L<perlunicode/User-Defined Character Properties> and L<perlsec>.
5076a392 2039
a593b319 2040=item panic: gp_free failed to free glob pointer - something is repeatedly re-creating entries
5076a392 2041
a593b319
FC
2042This new error is triggered if a destructor called on an object in a
2043typeglob that is being freed creates a new typeglob entry containing an
2044object with a destructor that creates a new entry containing an object....
5076a392 2045
a593b319 2046=item Parsing code internal error (%s)
5076a392 2047
a593b319
FC
2048This new fatal error is produced when parsing
2049code supplied by an extension violates the
2050parser's API in a detectable way.
5076a392 2051
a593b319 2052=item refcnt: fd %d%s
5076a392 2053
a593b319
FC
2054This new error only occurs if a internal consistency check fails when a
2055pipe is about to be closed.
5076a392 2056
a593b319 2057=item Regexp modifier "/%c" may not appear twice
5076a392 2058
a593b319
FC
2059The regular expression pattern has one of the
2060mutually exclusive modifiers repeated.
5076a392 2061
a593b319 2062=item Regexp modifiers "/%c" and "/%c" are mutually exclusive
5076a392 2063
a593b319
FC
2064The regular expression pattern has more than one of the mutually
2065exclusive modifiers.
5076a392 2066
a593b319 2067=item Using !~ with %s doesn't make sense
5076a392 2068
a593b319 2069This error occurs when C<!~> is used with C<s///r> or C<y///r>.
5076a392 2070
a593b319 2071=back
5076a392 2072
a593b319 2073=head3 New Warnings
5076a392 2074
a593b319 2075=over
5076a392 2076
a593b319 2077=item "\b{" is deprecated; use "\b\{" instead
5076a392 2078
a593b319 2079=item "\B{" is deprecated; use "\B\{" instead
5076a392 2080
a593b319
FC
2081Use of an unescaped "{" immediately following a C<\b> or C<\B> is now
2082deprecated so as to reserve its use for Perl itself in a future release.
5076a392 2083
a593b319 2084=item Operation "%s" returns its argument for ...
5076a392 2085
a593b319
FC
2086Performing an operation requiring Unicode semantics (such as case-folding)
2087on a Unicode surrogate or a non-Unicode character now triggers a warning:
2088'Operation "%s" returns its argument for ...'.
5076a392 2089
a593b319
FC
2090=item Use of qw(...) as parentheses is deprecated
2091
2092See L</"Use of qw(...) as parentheses">, above, for details.
5076a392
FC
2093
2094=back
2095
2096=head2 Changes to Existing Diagnostics
2097
2098=over 4
2099
2100=item *
2101
4ed2cea4
FC
2102The "Variable $foo is not imported" warning that precedes a
2103C<strict 'vars'> error has now been assigned the "misc" category, so that
2104C<no warnings> will suppress it [perl #73712].
2105
2106=item *
2107
5076a392
FC
2108C<warn> and C<die> now produce 'Wide character' warnings when fed a
2109character outside the byte range if STDERR is a byte-sized handle.
2110
2111=item *
2112
2113The 'Layer does not match this perl' error message has been replaced with
a593b319 2114these more helpful messages [perl #73754]:
5076a392
FC
2115
2116=over 4
2117
2118=item *
2119
2120PerlIO layer function table size (%d) does not match size expected by this
2121perl (%d)
2122
2123=item *
2124
2125PerlIO layer instance size (%d) does not match size expected by this perl
2126(%d)
2127
2128=back
2129
5076a392
FC
2130=item *
2131
2132The "Found = in conditional" warning that is emitted when a constant is
2133assigned to a variable in a condition is now withheld if the constant is
2134actually a subroutine or one generated by C<use constant>, since the value
2135of the constant may not be known at the time the program is written
2136[perl #77762].
2137
2138=item *
2139
2140Previously, if none of the C<gethostbyaddr>, C<gethostbyname> and
2141C<gethostent> functions were implemented on a given platform, they would
2142all die with the message 'Unsupported socket function "gethostent" called',
2143with analogous messages for C<getnet*> and C<getserv*>. This has been
2144corrected.
2145
2146=item *
2147
a593b319
FC
2148The warning message about unrecognized regular expression escapes passed
2149through has been changed to include any literal '{' following the
2150two-character escape. E.g., "\q{" is now emitted instead of "\q".
5076a392
FC
2151
2152=back
2153
2154=head1 Utility Changes
2155
0b88cc74 2156=head3 L<perlbug>
5076a392
FC
2157
2158=over 4
2159
2160=item *
2161
0b88cc74
FC
2162L<perlbug> now looks in the EMAIL environment variable for a return address
2163if the REPLY-TO and REPLYTO variables are empty.
5076a392
FC
2164
2165=item *
2166
0b88cc74
FC
2167L<perlbug> did not previously generate a From: header, potentially
2168resulting in dropped mail. Now it does include that header.
5076a392
FC
2169
2170=item *
2171
0b88cc74 2172The user's address is now used as the return-path.
4ed2cea4 2173
0b88cc74
FC
2174Many systems these days don't have a valid Internet domain name and
2175perlbug@perl.org does not accept email with a return-path that does
2176not resolve. So the user's address is now passed to sendmail so it's
2177less likely to get stuck in a mail queue somewhere [perl #82996].
5076a392 2178
2c389f6c
FC
2179=item *
2180
d430b8e7
FC
2181L<perlbug> now always gives the reporter a chance to change the email
2182address it guesses for them (5.12.2).
2183
2184=item *
2185
2186L<perlbug> should no longer warn about uninitialized values when using the C<-d>
2187and C<-v> options (5.12.2).
2c389f6c 2188
5076a392
FC
2189=back
2190
0b88cc74 2191=head3 L<perl5db.pl>
5076a392 2192
0b88cc74 2193=over
5076a392
FC
2194
2195=item *
2196
0b88cc74
FC
2197The remote terminal works after forking and spawns new sessions - one
2198for each forked process.
5076a392
FC
2199
2200=back
2201
0b88cc74 2202=head3 L<ptargrep>
5076a392
FC
2203
2204=over 4
2205
2206=item *
2207
0b88cc74
FC
2208L<ptargrep> is a new utility to apply pattern matching to the contents of
2209files in a tar archive. It comes with C<Archive::Tar>.
5076a392
FC
2210
2211=back
2212
2213=head1 Configuration and Compilation
2214
61752d82
FC
2215See also L</"Naming fixes in Policy_sh.SH may invalidate Policy.sh">,
2216above.
2217
5076a392
FC
2218=over 4
2219
2220=item *
2221
87595b22
FC
2222CCINCDIR and CCLIBDIR for the mingw64
2223cross-compiler are now correctly under
5076a392
FC
2224$(CCHOME)\mingw\include and \lib rather than immediately below $(CCHOME).
2225
5076a392
FC
2226This means the 'incpath', 'libpth', 'ldflags', 'lddlflags' and
2227'ldflags_nolargefiles' values in Config.pm and Config_heavy.pl are now
87595b22 2228set correctly.
5076a392
FC
2229
2230=item *
2231
87595b22
FC
2232'make test.valgrind' has been adjusted to account for cpan/dist/ext
2233separation.
5076a392
FC
2234
2235=item *
2236
2237On compilers that support it, C<-Wwrite-strings> is now added to cflags by
2238default.
2239
2240=item *
2241
2242The C<Encode> module can now (once again) be included in a static Perl
2243build. The special-case handling for this situation got broken in Perl
22445.11.0, and has now been repaired.
2245
1e463951
FC
2246=item *
2247
2248The previous default size of a PerlIO buffer (4096 bytes) has been increased
2249to the larger of 8192 bytes and your local BUFSIZ. Benchmarks show that doubling
2250this decade-old default increases read and write performance in the neighborhood
2251of 25% to 50% when using the default layers of perlio on top of unix. To choose
2252a non-default size, such as to get back the old value or to obtain an even
2253larger value, configure with:
2254
2255 ./Configure -Accflags=-DPERLIOBUF_DEFAULT_BUFSIZ=N
2256
2257where N is the desired size in bytes; it should probably be a multiple of
2258your page size.
2259
d430b8e7
FC
2260=item *
2261
2262An "incompatible operand types" error in ternary expressions when building
2263with C<clang> has been fixed (5.12.2).
2264
2265=item *
2266
2267Perl now skips setuid C<File::Copy> tests on partitions it detects to be mounted
2268as C<nosuid> (5.12.2).
2269
5076a392
FC
2270=back
2271
5076a392
FC
2272=head1 Platform Support
2273
5076a392
FC
2274=head2 New Platforms
2275
5076a392
FC
2276=over 4
2277
2278=item AIX
2279
cdc10f43 2280Perl now builds on AIX 4.2 (5.12.1).
5076a392
FC
2281
2282=back
2283
2284=head2 Discontinued Platforms
2285
2286=over 4
2287
5076a392
FC
2288=item Apollo DomainOS
2289
2290The last vestiges of support for this platform have been excised from the
2291Perl distribution. It was officially discontinued in version 5.12.0. It had
2292not worked for years before that.
2293
2294=item MacOS Classic
2295
2296The last vestiges of support for this platform have been excised from the
2297Perl distribution. It was officially discontinued in an earlier version.
2298
2299=back
2300
2301=head2 Platform-Specific Notes
2302
d430b8e7
FC
2303=head3 AIX
2304
2305=over
2306
2307=item *
2308
2309F<README.aix> has been updated with information about the XL C/C++ V11 compiler
2310suite (5.12.2).
2311
2312=back
2313
2314=head3 ARM
2315
2316=over
2317
2318=item *
2319
2320The C<d_u32align> configuration probe on ARM has been fixed (5.12.2).
2321
2322=back
2323
554003a2 2324=head3 Cygwin
5076a392
FC
2325
2326=over 4
2327
2328=item *
2329
554003a2 2330MakeMaker has been updated to build man pages on cygwin.
5076a392
FC
2331
2332=item *
2333
554003a2
FC
2334Improved rebase behaviour
2335
2336If a dll is updated on cygwin the old imagebase address is reused.
2337This solves most rebase errors, especially when updating on core dll's.
2338See L<http://www.tishler.net/jason/software/rebase/rebase-2.4.2.README> for more information.
5076a392
FC
2339
2340=item *
2341
554003a2 2342Support for the standard cygwin dll prefix, which is e.g. needed for FFI's
5076a392
FC
2343
2344=item *
2345
554003a2 2346Updated build hints file
5076a392
FC
2347
2348=back
2349
cdc10f43
FC
2350=head3 FreeBSD 7
2351
2352=over
2353
2354=item *
2355
2356FreeBSD 7 no longer contains F</usr/bin/objformat>. At build time,
2357Perl now skips the F<objformat> check for versions 7 and higher and
2358assumes ELF (5.12.1).
2359
2360=back
2361
2362=head3 HP-UX
2363
2364=over
2365
2366=item *
2367
2368Perl now allows -Duse64bitint without promoting to use64bitall on HP-UX
2369(5.12.1).
2370
2371=back
2372
554003a2 2373=head3 IRIX
5076a392
FC
2374
2375Conversion of strings to floating-point numbers is now more accurate on
2376IRIX systems [perl #32380].
2377
554003a2 2378=head3 Mac OS X
5076a392
FC
2379
2380Early versions of Mac OS X (Darwin) had buggy implementations of the
2381C<setregid>, C<setreuid>, C<setrgid> and C<setruid> functions, so perl
2382would pretend they did not exist.
2383
2384These functions are now recognised on Mac OS 10.5 (Leopard; Darwin 9) and
2385higher, as they have been fixed [perl #72990].
2386
554003a2 2387=head3 MirBSD
5076a392 2388
554003a2
FC
2389Previously if you built perl with a shared libperl.so on MirBSD (the
2390default config), it would work up to the installation; however, once
2391installed, it would be unable to find libperl. So path handling is now
2392treated as in the other BSD dialects.
5076a392 2393
554003a2 2394=head3 NetBSD
5076a392 2395
554003a2
FC
2396The NetBSD hints file has been changed to make the system's malloc the
2397default.
5076a392 2398
554003a2 2399=head3 Recent OpenBSDs now use perl's malloc
5076a392 2400
554003a2
FC
2401OpenBSD E<gt> 3.7 has a new malloc implementation which is mmap-based
2402and as such can release memory back to the OS; however, perl's use of
2403this malloc causes a substantial slowdown so we now default to using
2404perl's malloc instead [perl #75742].
5076a392 2405
554003a2 2406=head3 OpenVOS
5076a392 2407
554003a2 2408perl now builds again with OpenVOS (formerly known as Stratus VOS)
5a553547 2409[perl #78132] (5.12.3).
5076a392 2410
554003a2 2411=head3 Solaris
5076a392 2412
554003a2 2413DTrace is now supported on Solaris. There used to be build failures, but
5a553547 2414these have been fixed [perl #73630] (5.12.3).
5076a392 2415
554003a2 2416=head3 VMS
5076a392
FC
2417
2418=over
2419
2420=item *
2421
cdc10f43
FC
2422It's now possible to build extensions on older (pre 7.3-2) VMS systems.
2423
2424DCL symbol length was limited to 1K up until about seven years or
2425so ago, but there was no particularly deep reason to prevent those
2426older systems from configuring and building Perl (5.12.1).
2427
2428=item *
2429
2430We fixed the previously-broken C<-Uuseperlio> build on VMS.
2431
2432We were checking a variable that doesn't exist in the non-default
2433case of disabling perlio. Now we only look at it when it exists (5.12.1).
2434
2435=item *
2436
2437We fixed the -Uuseperlio command-line option in configure.com.
2438
2439Formerly it only worked if you went through all the questions
2440interactively and explicitly answered no (5.12.1).
2441
2442=item *
2443
554003a2 2444C<PerlIOUnix_open> now honours the default permissions on VMS.
5076a392 2445
554003a2
FC
2446When C<perlio> became the default and C<unixio> became the default bottom layer,
2447the most common path for creating files from Perl became C<PerlIOUnix_open>,
2448which has always explicitly used C<0666> as the permission mask.
5076a392 2449
554003a2
FC
2450To avoid this, C<0777> is now passed as the permissions to C<open()>. In the
2451VMS CRTL, C<0777> has a special meaning over and above intersecting with the
2452current umask; specifically, it allows Unix syscalls to preserve native default
5a553547
FC
2453permissions (5.12.3).
2454
2455=item *
2456
2457Spurious record boundaries are no longer
2458introduced by the PerlIO layer during output (5.12.3).
5076a392
FC
2459
2460=item *
2461
554003a2
FC
2462The shortening of symbols longer than 31 characters in the C sources is
2463now done by the compiler rather than by xsubpp (which could only do so
2464for generated symbols in XS code).
5076a392
FC
2465
2466=item *
2467
554003a2
FC
2468Record-oriented files (record format variable or variable with fixed control)
2469opened for write by the perlio layer will now be line-buffered to prevent the
2470introduction of spurious line breaks whenever the perlio buffer fills up.
5076a392 2471
d430b8e7
FC
2472=item *
2473
2474F<git_version.h> is now installed on VMS. This was an oversight in v5.12.0 which
2475caused some extensions to fail to build (5.12.2).
2476
2477=item *
2478
2479Several memory leaks in L<stat()|perlfunc/"stat FILEHANDLE"> have been fixed (5.12.2).
2480
2481=item *
2482
2483A memory leak in C<Perl_rename()> due to a double allocation has been
2484fixed (5.12.2).
2485
2486=item *
2487
2488A memory leak in C<vms_fid_to_name()> (used by C<realpath()> and
2489C<realname()>) has been fixed (5.12.2).
2490
5076a392
FC
2491=back
2492
554003a2 2493=head3 Windows
5076a392 2494
5a1f7719
FC
2495See also L</"fork() emulation will not wait for signalled children"> and
2496L</"Perl source code is read in text mode on Windows">, above.
2497
5076a392
FC
2498=over 4
2499
2500=item *
2501
554003a2 2502Fixed build process for SDK2003SP1 compilers.
5076a392 2503
554003a2 2504=item *
5076a392 2505
01b1a9e4
FC
2506Compilation with Visual Studio 2010 is now supported.
2507
2508=item *
2509
554003a2
FC
2510When using old 32-bit compilers, the define C<_USE_32BIT_TIME_T> will now
2511be set in C<$Config{ccflags}>. This improves portability when compiling
2512XS extensions using new compilers, but for a perl compiled with old 32-bit
2513compilers.
5076a392
FC
2514
2515=item *
2516
554003a2
FC
2517C<$Config{gccversion}> is now set correctly when perl is built using the
2518mingw64 compiler from L<http://mingw64.org> [perl #73754].
5076a392 2519
554003a2
FC
2520=item *
2521
d430b8e7
FC
2522When building Perl with the mingw64 x64 cross-compiler C<incpath>,
2523C<libpth>, C<ldflags>, C<lddlflags> and C<ldflags_nolargefiles> values
2524in F<Config.pm> and F<Config_heavy.pl> were not previously being set
2525correctly because, with that compiler, the include and lib directories
2526are not immediately below C<$(CCHOME)> (5.12.2).
2527
2528=item *
2529
554003a2
FC
2530The build process proceeds more smoothly with mingw and dmake when
2531F<C:\MSYS\bin> is in the PATH, due to a C<Cwd> fix.
5076a392
FC
2532
2533=item *
2534
554003a2
FC
2535Support for building with Visual C++ 2010 is now underway, but is not yet
2536complete. See F<README.win32> or L<perlwin32> for more details.
5076a392 2537
554003a2
FC
2538=item *
2539
2540The option to use an externally-supplied C<crypt()>, or to build with no
2541C<crypt()> at all, has been removed. Perl supplies its own C<crypt()>
2542implementation for Windows, and the political situation that required
2543this part of the distribution to sometimes be omitted is long gone.
5076a392
FC
2544
2545=back
2546
2547=head1 Internal Changes
2548
1e463951 2549=head2 New APIs
5076a392 2550
1e463951 2551=head3 CLONE_PARAMS structure added to ease correct thread creation
5076a392 2552
1e463951
FC
2553Modules that create threads should now create C<CLONE_PARAMS> structures
2554by calling the new function C<Perl_clone_params_new()>, and free them with
2555C<Perl_clone_params_del()>. This will ensure compatibility with any future
2556changes to the internals of the C<CLONE_PARAMS> structure layout, and that
2557it is correctly allocated and initialised.
5076a392 2558
1e463951 2559=head3 New parsing functions
5076a392 2560
1e463951
FC
2561Several functions have been added for parsing statements or multiple
2562statements:
5076a392 2563
1e463951 2564=over
5076a392
FC
2565
2566=item *
2567
1e463951 2568C<parse_fullstmt> parses a complete Perl statement.
5076a392
FC
2569
2570=item *
2571
1e463951
FC
2572C<parse_stmtseq> parses a sequence of statements, up
2573to closing brace or EOF.
5076a392
FC
2574
2575=item *
2576
1e463951 2577C<parse_block> parses a block [perl #78222].
5076a392
FC
2578
2579=item *
2580
1e463951
FC
2581C<parse_barestmt> parses a statement
2582without a label.
5076a392
FC
2583
2584=item *
2585
1e463951 2586C<parse_label> parses a statement label, separate from statements.
5076a392 2587
1e463951 2588=back
5076a392 2589
1e463951
FC
2590The
2591L<C<parse_fullexpr()>|perlapi/parse_fullexpr>,
2592L<C<parse_listexpr()>|perlapi/parse_listexpr>,
2593L<C<parse_termexpr()>|perlapi/parse_termexpr>, and
2594L<C<parse_arithexpr()>|perlapi/parse_arithexpr>
2595functions have been added to the API. They perform
2596recursive-descent parsing of expressions at various precedence levels.
2597They are expected to be used by syntax plugins.
5076a392 2598
1e463951 2599See L<perlapi> for details.
5076a392 2600
1e463951 2601=head3 Hints hash API
5076a392 2602
1e463951
FC
2603A new C API for introspecting the hinthash C<%^H> at runtime has been
2604added. See C<cop_hints_2hv>, C<cop_hints_fetchpvn>, C<cop_hints_fetchpvs>,
2605C<cop_hints_fetchsv>, and C<hv_copy_hints_hv> in L<perlapi> for details.
5076a392 2606
1e463951
FC
2607A new, experimental API has been added for accessing the internal
2608structure that Perl uses for C<%^H>. See the functions beginning with
2609C<cophh_> in L<perlapi>.
5076a392 2610
1e463951 2611=head3 C interface to C<caller()>
5076a392 2612
1e463951
FC
2613The C<caller_cx> function has been added as an XSUB-writer's equivalent of
2614C<caller()>. See L<perlapi> for details.
5076a392 2615
1e463951 2616=head3 Custom per-subroutine check hooks
5076a392 2617
1e463951
FC
2618XS code in an extension module can now annotate a subroutine (whether
2619implemented in XS or in Perl) so that nominated XS code will be called
2620at compile time (specifically as part of op checking) to change the op
2621tree of that subroutine. The compile-time check function (supplied by
2622the extension module) can implement argument processing that can't be
2623expressed as a prototype, generate customised compile-time warnings,
2624perform constant folding for a pure function, inline a subroutine
2625consisting of sufficiently simple ops, replace the whole call with a
2626custom op, and so on. This was previously all possible by hooking the
2627C<entersub> op checker, but the new mechanism makes it easy to tie the
2628hook to a specific subroutine. See L<perlapi/cv_set_call_checker>.
5076a392 2629
1e463951
FC
2630To help in writing custom check hooks, several subtasks within standard
2631C<entersub> op checking have been separated out and exposed in the API.
5076a392 2632
1e463951 2633=head3 Improved support for custom OPs
5076a392 2634
1e463951
FC
2635Custom ops can now be registered with the new C<custom_op_register> C
2636function and the C<XOP> structure. This will make it easier to add new
2637properties of custom ops in the future. Two new properties have been added
2638already, C<xop_class> and C<xop_peep>.
5076a392 2639
1e463951
FC
2640C<xop_class> is one of the OA_*OP constants, and allows L<B> and other
2641introspection mechanisms to work with custom ops
2642that aren't BASEOPs. C<xop_peep> is a pointer to
2643a function that will be called for ops of this
2644type from C<Perl_rpeep>.
5076a392 2645
1e463951
FC
2646See L<perlguts/Custom Operators> and L<perlapi/Custom Operators> for more
2647detail.
5076a392 2648
1e463951
FC
2649The old C<PL_custom_op_names>/C<PL_custom_op_descs> interface is still
2650supported but discouraged.
5076a392 2651
1e463951 2652=head3 Scope hooks
5076a392 2653
1e463951
FC
2654It is now possible for XS code to hook into Perl's lexical scope
2655mechanism at compile time, using the new C<Perl_blockhook_register>
2656function. See L<perlguts/"Compile-time scope hooks">.
5076a392 2657
1e463951 2658=head3 The recursive part of the peephole optimizer is now hookable
5076a392
FC
2659
2660In addition to C<PL_peepp>, for hooking into the toplevel peephole optimizer, a
2661C<PL_rpeepp> is now available to hook into the optimizer recursing into
2662side-chains of the optree.
2663
1e463951 2664=head3 New non-magical variants of existing functions
5076a392 2665
1e463951
FC
2666The following functions/macros have been added to the API. The C<*_nomg>
2667macros are equivalent to their non-_nomg variants, except that they ignore
2668get-magic. Those ending in C<_flags> allow one to specify whether
2669get-magic is processed.
5076a392 2670
1e463951
FC
2671 sv_2bool_flags
2672 SvTRUE_nomg
2673 sv_2nv_flags
2674 SvNV_nomg
2675 sv_cmp_flags
2676 sv_cmp_locale_flags
2677 sv_eq_flags
2678 sv_collxfrm_flags
5076a392 2679
1e463951 2680In some of these cases, the non-_flags functions have
5076a392
FC
2681been replaced with wrappers around the new functions.
2682
1e463951 2683=head3 pv/pvs/sv versions of existing functions
5076a392 2684
1e463951 2685Many functions ending with pvn now have equivalent pv/pvs/sv versions.
5076a392 2686
1e463951 2687=head3 List op-building functions
5076a392 2688
1e463951
FC
2689List op-building functions have been added to the
2690API. See L<op_append_elem|perlapi/op_append_elem>,
2691L<op_append_list|perlapi/op_append_list>, and
2692L<op_prepend_elem|perlapi/op_prepend_elem> in L<perlapi>.
5076a392 2693
1e463951 2694=head3 C<LINKLIST>
5076a392 2695
1e463951
FC
2696The L<LINKLIST|perlapi/LINKLIST> macro, part of op building that
2697constructs the execution-order op chain, has been added to the API.
5076a392 2698
1e463951 2699=head3 Localisation functions
5076a392 2700
1e463951
FC
2701The C<save_freeop>, C<save_op>, C<save_pushi32ptr> and C<save_pushptrptr>
2702functions have been added to the API.
5076a392 2703
1e463951 2704=head3 Stash names
5076a392 2705
1e463951
FC
2706A stash can now have a list of effective names in addition to its usual
2707name. The first effective name can be accessed via the C<HvENAME> macro,
2708which is now the recommended name to use in MRO linearisations (C<HvNAME>
2709being a fallback if there is no C<HvENAME>).
5076a392 2710
1e463951
FC
2711These names are added and deleted via C<hv_ename_add> and
2712C<hv_ename_delete>. These two functions are I<not> part of the API.
5076a392 2713
1e463951 2714=head3 New functions for finding and removing magic
5076a392 2715
1e463951
FC
2716The L<C<mg_findext()>|perlapi/mg_findext> and
2717L<C<sv_unmagicext()>|perlapi/sv_unmagicext>
2718functions have been added to the API.
2719They allow extension authors to find and remove magic attached to
2720scalars based on both the magic type and the magic virtual table, similar to how
2721C<sv_magicext()> attaches magic of a certain type and with a given virtual table
2722to a scalar. This eliminates the need for extensions to walk the list of
2723C<MAGIC> pointers of an C<SV> to find the magic that belongs to them.
5076a392 2724
1e463951 2725=head3 C<find_rundefsv>
5076a392 2726
1e463951
FC
2727This function returns the SV representing C<$_>, whether it's lexical
2728or dynamic.
5076a392 2729
1e463951 2730=head3 C<Perl_croak_no_modify>
5076a392 2731
1e463951
FC
2732C<Perl_croak_no_modify()> is short-hand for
2733C<Perl_croak("%s", PL_no_modify)>.
5076a392 2734
1e463951 2735=head3 C<PERL_STATIC_INLINE> define
5076a392 2736
1e463951
FC
2737The C<PERL_STATIC_INLINE> define has been added to provide the best-guess
2738incantation to use for static inline functions, if the C compiler supports
2739C99-style static inline. If it doesn't, it'll give a plain C<static>.
5076a392 2740
1e463951
FC
2741C<HAS_STATIC_INLINE> can be used to check if the compiler actually supports
2742inline functions.
5076a392 2743
1e463951 2744=head3 New C<pv_escape> option for hexadecimal escapes
5076a392 2745
1e463951
FC
2746A new option, C<PERL_PV_ESCAPE_NONASCII>, has been added to C<pv_escape> to
2747dump all characters above ASCII in hexadecimal. Before, one could get all
2748characters as hexadecimal or the Latin1 non-ASCII as octal.
5076a392 2749
1e463951 2750=head3 C<lex_start>
5076a392 2751
1e463951 2752C<lex_start> has been added to the API, but is considered experimental.
5076a392 2753
1e463951 2754=head3 C<op_scope()> and C<op_lvalue()>
5076a392 2755
1e463951
FC
2756The C<op_scope()> and C<op_lvalue()> functions have been added to the API,
2757but are considered experimental.
5076a392 2758
1e463951 2759=head2 C API Changes
5076a392 2760
1e463951 2761=head3 C<PERL_POLLUTE> has been removed
5076a392 2762
1e463951
FC
2763The option to define C<PERL_POLLUTE> to expose older 5.005 symbols for
2764backwards compatibility has been removed. It's use was always discouraged,
2765and MakeMaker contains a more specific escape hatch:
5076a392 2766
1e463951 2767 perl Makefile.PL POLLUTE=1
5076a392 2768
1e463951
FC
2769This can be used for modules that have not been upgraded to 5.6 naming
2770conventions (and really should be completely obsolete by now).
5076a392 2771
1e463951 2772=head3 Check API compatibility when loading XS modules
5076a392 2773
1e463951
FC
2774When perl's API changes in incompatible ways (which usually happens between
2775major releases), XS modules compiled for previous versions of perl will not
2776work anymore. They will need to be recompiled against the new perl.
5076a392 2777
1e463951
FC
2778In order to ensure that modules are recompiled, and to prevent users from
2779accidentally loading modules compiled for old perls into newer ones, the
2780C<XS_APIVERSION_BOOTCHECK> macro has been added. That macro, which is
2781called when loading every newly compiled extension, compares the API
2782version of the running perl with the version a module has been compiled for
2783and raises an exception if they don't match.
5076a392 2784
1e463951 2785=head3 Perl_fetch_cop_label
5076a392 2786
1e463951
FC
2787The first argument of the C API function C<Perl_fetch_cop_label> has changed
2788from C<struct refcounted he *> to C<COP *>, to insulate the user from
2789implementation details.
5076a392 2790
1e463951
FC
2791This API function was marked as "may change", and likely isn't in use outside
2792the core. (Neither an unpacked CPAN, nor Google's codesearch, finds any other
2793references to it.)
5076a392 2794
1e463951 2795=head3 GvCV() and GvGP() are no longer lvalues
5076a392 2796
1e463951
FC
2797The new GvCV_set() and GvGP_set() macros are now provided to replace
2798assignment to those two macros.
5076a392 2799
1e463951
FC
2800This allows a future commit to eliminate some backref magic between GV
2801and CVs, which will require complete control over assignment to the
2802gp_cv slot.
5076a392 2803
1e463951 2804=head3 CvGV() is no longer an lvalue
5076a392 2805
1e463951
FC
2806Under some circumstances, the C<CvGV()> field of a CV is now
2807reference-counted. To ensure consistent behaviour, direct assignment to
2808it, for example C<CvGV(cv) = gv> is now a compile-time error. A new macro,
2809C<CvGV_set(cv,gv)> has been introduced to perform this operation
2810safely. Note that modification of this field is not part of the public
2811API, regardless of this new macro (and despite its being listed in this section).
5076a392 2812
1e463951 2813=head3 CvSTASH() is no longer an lvalue
5076a392 2814
1e463951
FC
2815The C<CvSTASH()> macro can now only be used as an rvalue. C<CvSTASH_set()>
2816has been added to replace assignment to C<CvSTASH()>. This is to ensure
2817that backreferences are handled properly. These macros are not part of the
2818API.
5076a392 2819
1e463951 2820=head3 Calling conventions for C<newFOROP> and C<newWHILEOP>
5076a392 2821
1e463951
FC
2822The way the parser handles labels has been cleaned up and refactored. As a
2823result, the C<newFOROP()> constructor function no longer takes a parameter
2824stating what label is to go in the state op.
5076a392 2825
1e463951
FC
2826The C<newWHILEOP()> and C<newFOROP()> functions no longer accept a line
2827number as a parameter.
5076a392 2828
1e463951 2829=head3 Flags passed to C<uvuni_to_utf8_flags> and C<utf8n_to_uvuni>
5076a392 2830
1e463951
FC
2831Some of the flags parameters to uvuni_to_utf8_flags() and
2832utf8n_to_uvuni() have changed. This is a result of Perl's now allowing
5076a392
FC
2833internal storage and manipulation of code points that are problematic
2834in some situations. Hence, the default actions for these functions has
2835been complemented to allow these code points. The new flags are
2836documented in L<perlapi>. Code that requires the problematic code
2837points to be rejected needs to change to use these flags. Some flag
2838names are retained for backward source compatibility, though they do
2839nothing, as they are now the default. However the flags
2840C<UNICODE_ALLOW_FDD0>, C<UNICODE_ALLOW_FFFF>, C<UNICODE_ILLEGAL>, and
2841C<UNICODE_IS_ILLEGAL> have been removed, as they stem from a
2842fundamentally broken model of how the Unicode non-character code points
2843should be handled, which is now described in
2844L<perlunicode/Non-character code points>. See also L</Selected Bug Fixes>.
2845
1e463951
FC
2846XXX Which bugs in particular? Selected Bug Fixes is too long for this link
2847to be meaningful right now.
5076a392 2848
1e463951 2849=head2 Deprecated C APIs
5076a392 2850
1e463951 2851=over
5076a392 2852
1e463951 2853=item C<Perl_ptr_table_clear>
5076a392 2854
1e463951
FC
2855C<Perl_ptr_table_clear> is no longer part of Perl's public API. Calling it
2856now generates a deprecation warning, and it will be removed in a future
2857release.
5076a392 2858
1e463951 2859=item C<sv_compile_2op>
5076a392 2860
1e463951
FC
2861The C<sv_compile_2op()> API function is now deprecated. Searches suggest
2862that nothing on CPAN is using it, so this should have zero impact.
5076a392 2863
1e463951
FC
2864It attempted to provide an API to compile code down to an optree, but failed
2865to bind correctly to lexicals in the enclosing scope. It's not possible to
2866fix this problem within the constraints of its parameters and return value.
5076a392 2867
1e463951 2868=item C<find_rundefsvoffset>
5076a392 2869
1e463951
FC
2870The C<find_rundefsvoffset> function has been deprecated. It appeared that
2871its design was insufficient for reliably getting the lexical C<$_> at
2872run-time.
5076a392 2873
1e463951
FC
2874Use the new C<find_rundefsv> function or the C<UNDERBAR> macro
2875instead. They directly return the right SV representing C<$_>, whether it's
2876lexical or dynamic.
5076a392 2877
1e463951 2878=item C<CALL_FPTR> and C<CPERLscope>
5076a392 2879
1e463951
FC
2880Those are left from an old implementation of C<MULTIPLICITY> using C++ objects,
2881which was removed in Perl 5.8. Nowadays these macros do exactly nothing, so
2882they shouldn't be used anymore.
5076a392 2883
1e463951
FC
2884For compatibility, they are still defined for external C<XS> code. Only
2885extensions defining C<PERL_CORE> must be updated now.
5076a392 2886
1e463951 2887=back
5076a392 2888
1e463951 2889=head2 Other Internal Changes
5076a392 2890
1e463951 2891=head3 Stack unwinding
5076a392 2892
1e463951
FC
2893The protocol for unwinding the C stack at the last stage of a C<die>
2894has changed how it identifies the target stack frame. This now uses
2895a separate variable C<PL_restartjmpenv>, where previously it relied on
2896the C<blk_eval.cur_top_env> pointer in the C<eval> context frame that
2897has nominally just been discarded. This change means that code running
2898during various stages of Perl-level unwinding no longer needs to take
2899care to avoid destroying the ghost frame.
5076a392 2900
1e463951 2901=head3 Scope stack entries
5076a392 2902
1e463951
FC
2903The format of entries on the scope stack has been changed, resulting in a
2904reduction of memory usage of about 10%. In particular, the memory used by
2905the scope stack to record each active lexical variable has been halved.
5076a392 2906
1e463951 2907=head3 Memory allocation for pointer tables
5076a392 2908
1e463951
FC
2909Memory allocation for pointer tables has been changed. Previously
2910C<Perl_ptr_table_store> allocated memory from the same arena system as
2911C<SV> bodies and C<HE>s, with freed memory remaining bound to those arenas
2912until interpreter exit. Now it allocates memory from arenas private to the
2913specific pointer table, and that memory is returned to the system when
2914C<Perl_ptr_table_free> is called. Additionally, allocation and release are
2915both less CPU intensive.
5076a392 2916
1e463951 2917=head3 C<UNDERBAR>
5076a392 2918
1e463951
FC
2919The C<UNDERBAR> macro now calls C<find_rundefsv>. C<dUNDERBAR> is now a
2920noop but should still be used to ensure past and future compatibility.
5076a392 2921
1e463951 2922=head3 String comparison routines renamed
5076a392 2923
1e463951
FC
2924The ibcmp_* functions have been renamed and are now called foldEQ,
2925foldEQ_locale and foldEQ_utf8. The old names are still available as
2926macros.
2927
2928=head3 C<chop> and C<chomp> implementations merged
2929
2930The opcode bodies for C<chop> and C<chomp> and for C<schop> and C<schomp>
2931have been merged. The implementation functions C<Perl_do_chop()> and
2932C<Perl_do_chomp()>, never part of the public API, have been merged and
2933moved to a static function in F<pp.c>. This shrinks the perl binary
2934slightly, and should not affect any code outside the core (unless it is
2935relying on the order of side effects when C<chomp> is passed a I<list> of
2936values).
5076a392
FC
2937
2938=head1 Selected Bug Fixes
2939
e8e35311
FC
2940=head2 I/O
2941
5076a392
FC
2942=over 4
2943
2944=item *
2945
e8e35311 2946Perl no longer produces this warning:
a593b319
FC
2947
2948 $ perl -we 'open my $f, ">", \my $x; binmode $f, "scalar"'
2949 Use of uninitialized value in binmode at -e line 1.
2950
2951=item *
2952
e8e35311
FC
2953Opening a glob reference via C<< open $fh, "E<gt>", \*glob >> will no longer
2954cause the glob to be corrupted when the filehandle is printed to. This would
2955cause perl to crash whenever the glob's contents were accessed
2956[perl #77492].
4ed2cea4
FC
2957
2958=item *
2959
e8e35311
FC
2960PerlIO no longer crashes when called recursively, e.g., from a signal
2961handler. Now it just leaks memory [perl #75556].
4ed2cea4
FC
2962
2963=item *
2964
e8e35311
FC
2965Most I/O functions were not warning for unopened handles unless the
2966'closed' and 'unopened' warnings categories were both enabled. Now only
2967C<use warnings 'unopened'> is necessary to trigger these warnings (as was
438c239f 2968always meant to be the case).
4ed2cea4
FC
2969
2970=item *
2971
438c239f 2972There have been several fixes to PerlIO layers:
e8e35311 2973
438c239f
FC
2974When C<binmode FH, ":crlf"> pushes the C<:crlf> layer on top of the stack,
2975it no longer enables crlf layers lower in the stack, to avoid unexpected
2976results [perl #38456].
4ed2cea4 2977
438c239f
FC
2978Opening a file in C<:raw> mode now does what it advertises to do (first
2979open the file, then binmode it), instead of simply leaving off the top
2980layer [perl #80764].
5076a392 2981
438c239f
FC
2982The three layers C<:pop>, C<:utf8> and C<:bytes> didn't allow stacking when
2983opening a file. For example
e8e35311 2984this:
5076a392 2985
e8e35311 2986 open FH, '>:pop:perlio', 'some.file' or die $!;
5076a392 2987
438c239f
FC
2988Would throw an error: "Invalid argument". This has been fixed in this
2989release [perl #82484].
5076a392 2990
e8e35311
FC
2991=back
2992
2993=head2 Regular Expression Bug Fixes
2994
2995=over
5076a392
FC
2996
2997=item *
2998
e8e35311
FC
2999The regular expression engine no longer loops when matching
3000C<"\N{LATIN SMALL LIGATURE FF}" =~ /f+/i> and similar expressions
cdc10f43 3001[perl #72998] (5.12.1).
5076a392
FC
3002
3003=item *
3004
e8e35311
FC
3005The trie runtime code should no longer allocate massive amounts of memory,
3006fixing #74484.
5076a392
FC
3007
3008=item *
3009
438c239f
FC
3010Syntax errors in C<< (?{...}) >> blocks no longer cause panic messages
3011[perl #2353].
5076a392
FC
3012
3013=item *
3014
438c239f
FC
3015A pattern like C<(?:(o){2})?> no longer causes a "panic" error
3016[perl #39233].
5076a392
FC
3017
3018=item *
3019
438c239f 3020A fatal error in regular expressions containing C<(.*?)> when processing
d430b8e7 3021UTF-8 data has been fixed [perl #75680] (5.12.2).
5076a392
FC
3022
3023=item *
3024
e8e35311 3025An erroneous regular expression engine optimisation that caused regex verbs like
438c239f 3026C<*COMMIT> sometimes to be ignored has been removed.
5076a392
FC
3027
3028=item *
3029
e8e35311
FC
3030The regular expression bracketed character class C<[\8\9]> was effectively the
3031same as C<[89\000]>, incorrectly matching a NULL character. It also gave
3032incorrect warnings that the C<8> and C<9> were ignored. Now C<[\8\9]> is the
3033same as C<[89]> and gives legitimate warnings that C<\8> and C<\9> are
3034unrecognized escape sequences, passed-through.
5076a392
FC
3035
3036=item *
3037
e8e35311
FC
3038A regular expression match in the right-hand side of a global substitution
3039(C<s///g>) that is in the same scope will no longer cause match variables
3040to have the wrong values on subsequent iterations. This can happen when an
3041array or hash subscript is interpolated in the right-hand side, as in
3042C<s|(.)|@a{ print($1), /./ }|g> [perl #19078].
5076a392
FC
3043
3044=item *
3045
438c239f
FC
3046Several cases in which characters in the Latin-1 non-ASCII range (0x80 to
30470xFF) used not to match themselves or used to match both a character class
3048and its complement have been fixed. For instance, U+00E2 could match both
3049C<\w> and C<\W> [perl #78464] [perl #18281] [perl #60156].
5076a392
FC
3050
3051=item *
3052
e8e35311
FC
3053Matching a Unicode character against an alternation containing characters
3054that happened to match continuation bytes in the former's UTF8
3055representation (C<qq{\x{30ab}} =~ /\xab|\xa9/>) would cause erroneous
3056warnings [perl #70998].
5076a392
FC
3057
3058=item *
3059
e8e35311
FC
3060The trie optimisation was not taking empty groups into account, preventing
3061'foo' from matching C</\A(?:(?:)foo|bar|zot)\z/> [perl #78356].
5076a392
FC
3062
3063=item *
3064
e8e35311
FC
3065A pattern containing a C<+> inside a lookahead would sometimes cause an
3066incorrect match failure in a global match (e.g., C</(?=(\S+))/g>)
3067[perl #68564].
5076a392
FC
3068
3069=item *
3070
e8e35311
FC
3071A regular expression optimisation would sometimes cause a match with a
3072C<{n,m}> quantifier to fail when it should match [perl #79152].
5076a392
FC
3073
3074=item *
3075
e8e35311 3076Case insensitive matching in regular expressions compiled under C<use
438c239f
FC
3077locale> now works much more sanely when the pattern or
3078target string is encoded internally in
3079UTF8. Previously, under these conditions the localeness
e8e35311
FC
3080was completely lost. Now, code points above 255 are treated as Unicode,
3081but code points between 0 and 255 are treated using the current locale
438c239f
FC
3082rules, regardless of whether the pattern or the string is encoded in UTF8.
3083The few case-insensitive matches that cross the 255/256 boundary are not
e8e35311
FC
3084allowed. For example, 0xFF does not caselessly match the character at
30850x178, LATIN CAPITAL LETTER Y WITH DIAERESIS, because 0xFF may not be
3086LATIN SMALL LETTER Y in the current locale, and Perl has no way of
3087knowing if that character even exists in the locale, much less what code
3088point it is.
5076a392
FC
3089
3090=item *
3091
e8e35311
FC
3092The C<(?|...)> regular expression construct no longer crashes if the final
3093branch has more sets of capturing parentheses than any other branch. This
3094was fixed in Perl 5.10.1 for the case of a single branch, but that fix did
3095not take multiple branches into account [perl #84746].
5076a392
FC
3096
3097=item *
3098
e8e35311
FC
3099A bug has been fixed in the implementation of C<{...}> quantifiers in
3100regular expressions that prevented the code block in
3101C</((\w+)(?{ print $2 })){2}/> from seeing the C<$2> sometimes
3102[perl #84294].
5076a392 3103
e8e35311 3104=back
5076a392 3105
e8e35311
FC
3106=head2 Syntax/Parsing Bugs
3107
3108=over
5076a392
FC
3109
3110=item *
3111
e8e35311 3112C<when(scalar){...}> no longer crashes, but produces a syntax error
cdc10f43 3113[perl #74114] (5.12.1).
5076a392
FC
3114
3115=item *
3116
e8e35311
FC
3117A label right before a string eval (C<foo: eval $string>) no longer causes
3118the label to be associated also with the first statement inside the eval
3119[perl #74290] (5.12.1).
5076a392
FC
3120
3121=item *
3122
b2c076b5 3123The C<no 5.13.2;> form of C<no> no longer tries to turn on features or
d430b8e7 3124pragmata (i.e., strict) [perl #70075] (5.12.2).
5076a392
FC
3125
3126=item *
3127
b2c076b5
FC
3128C<BEGIN {require 5.12.0}> now behaves as documented, rather than behaving
3129identically to C<use 5.12.0;>. Previously, C<require> in a C<BEGIN> block
3130was erroneously executing the C<use feature ':5.12.0'> and
3131C<use strict;> behaviour, which only C<use> was documented to
3132provide [perl #69050].
5076a392
FC
3133
3134=item *
3135
5076a392
FC
3136A regression introduced in Perl 5.12.0, making
3137C<< my $x = 3; $x = length(undef) >> result in C<$x> set to C<3> has been
d430b8e7 3138fixed. C<$x> will now be C<undef> [perl #85508] (5.12.2).
b2c076b5
FC
3139
3140=item *
3141
3142When strict 'refs' mode is off, C<%{...}> in rvalue context returns
3143C<undef> if its argument is undefined. An optimisation introduced in perl
31445.12.0 to make C<keys %{...}> faster when used as a boolean did not take
3145this into account, causing C<keys %{+undef}> (and C<keys %$foo> when
3146C<$foo> is undefined) to be an error, which it should only be in strict
3147mode [perl #81750].
5076a392
FC
3148
3149=item *
3150
e8e35311 3151Constant-folding used to cause
5076a392 3152
e8e35311 3153 $text =~ ( 1 ? /phoo/ : /bear/)
5076a392 3154
e8e35311
FC
3155to turn into
3156
3157 $text =~ /phoo/
3158
3159at compile time. Now it correctly matches against C<$_> [perl #20444].
5076a392
FC
3160
3161=item *
3162
e8e35311
FC
3163Parsing Perl code (either with string C<eval> or by loading modules) from
3164within a C<UNITCHECK> block no longer causes the interpreter to crash
3165[perl #70614].
5076a392
FC
3166
3167=item *
3168
b2c076b5
FC
3169String evals no longer fail after 2 billion scopes have been
3170compiled [perl #83364].
3171
3172=item *
3173
e8e35311
FC
3174The parser no longer hangs when encountering certain Unicode characters,
3175such as U+387 [perl #74022].
5076a392
FC
3176
3177=item *
3178
b2c076b5
FC
3179Several contexts no longer allow a Unicode character to begin a word
3180that should never begin words, for an example an accent that must follow
3181another character previously could precede all other characters.
5076a392
FC
3182
3183=item *
3184
e8e35311
FC
3185Defining a constant with the same name as one of perl's special blocks
3186(e.g., INIT) stopped working in 5.12.0, but has now been fixed
3187[perl #78634].
5076a392
FC
3188
3189=item *
3190
e8e35311
FC
3191A reference to a literal value used as a hash key (C<$hash{\"foo"}>) used
3192to be stringified, even if the hash was tied [perl #79178].
5076a392
FC
3193
3194=item *
3195
e8e35311
FC
3196A closure containing an C<if> statement followed by a constant or variable
3197is no longer treated as a constant [perl #63540].
5076a392
FC
3198
3199=item *
3200
e8e35311
FC
3201C<state> can now be used with attributes. It used to mean the same thing as
3202C<my> if attributes were present [perl #68658].
5076a392
FC
3203
3204=item *
3205
e8e35311
FC
3206Expressions like C<< @$a > 3 >> no longer cause C<$a> to be mentioned in
3207the "Use of uninitialized value in numeric gt" warning when C<$a> is
3208undefined (since it is not part of the C<E<gt>> expression, but the operand
3209of the C<@>) [perl #72090].
5076a392
FC
3210
3211=item *
3212
e8e35311
FC
3213Accessing an element of a package array with a hard-coded number (as
3214opposed to an arbitrary expression) would crash if the array did not exist.
3215Usually the array would be autovivified during compilation, but typeglob
3216manipulation could remove it, as in these two cases which used to crash:
5076a392 3217
e8e35311
FC
3218 *d = *a; print $d[0];
3219 undef *d; print $d[0];
5076a392 3220
2c389f6c
FC
3221=item *
3222
3223The C<-C> command line option, when used on the shebang line, can now be
3224followed by other options [perl #72434].
3225
3226=item *
3227
3228The C<B> module was returning C<B::OP>s instead of C<B::LOGOP>s for C<entertry> [perl #80622].
3229This was due to a bug in the perl core, not in C<B> itself.
3230
e8e35311 3231=back
5076a392 3232
e262cb24
FC
3233=head2 Stashes, Globs and Method Lookup
3234
3235Perl 5.10.0 introduced a new internal mechanism for caching MROs (method
3236resolution orders, or lists of parent classes; aka "isa" caches) to make
3237method lookup faster (so @ISA arrays would not have to be searched
3238repeatedly). Unfortunately, this brought with it quite a few bugs. Almost
3239all of these have been fixed now, along with a few MRO-related bugs that
3240existed before 5.10.0:
3241
3242=over
3243
3244=item *
3245
3246The following used to have erratic effects on method resolution, because
3247the "isa" caches were not reset or otherwise ended up listing the wrong
3248classes. These have been fixed.
3249
3250=over
3251
3252=item Aliasing packages by assigning to globs [perl #77358]
3253
3254=item Deleting packages by deleting their containing stash elements
3255
3256=item Undefining the glob containing a package (C<undef *Foo::>)
3257
3258=item Undefining an ISA glob (C<undef *Foo::ISA>)
3259
3260=item Deleting an ISA stash element (C<delete $Foo::{ISA}>)
3261
3262=item Sharing @ISA arrays between classes (via C<*Foo::ISA = \@Bar::ISA> or
3263C<*Foo::ISA = *Bar::ISA>) [perl #77238]
3264
3265=back
3266
3267C<undef *Foo::ISA> would even stop a new C<@Foo::ISA> array from updating
3268caches.
3269
3270=item *
3271
3272Typeglob assignments would crash if the glob's stash no longer existed, so
3273long as the glob assigned to was named 'ISA' or the glob on either side of
3274the assignment contained a subroutine.
3275
3276=item *
3277
3278C<PL_isarev>, which is accessible to Perl via C<mro::get_isarev> is now
3279updated properly when packages are deleted or removed from the C<@ISA> of
3280other classes. This allows many packages to be created and deleted without
3281causing a memory leak [perl #75176].
3282
3283=back
3284
3285In addition, various other bugs related to typeglobs and stashes have been
3286fixed:
5076a392 3287
e8e35311 3288=over
5076a392
FC
3289
3290=item *
3291
e8e35311 3292Some work has been done on the internal pointers that link between symbol
e262cb24 3293tables (stashes), typeglobs and subroutines. This has the effect that
e8e35311
FC
3294various edge cases related to deleting stashes or stash entries (e.g.
3295<%FOO:: = ()>), and complex typeglob or code reference aliasing, will no
3296longer crash the interpreter.
5076a392
FC
3297
3298=item *
3299
e262cb24
FC
3300Assigning a reference to a glob copy now assigns to a glob slot instead of
3301overwriting the glob with a scalar [perl #1804] [perl #77508].
5076a392
FC
3302
3303=item *
3304
e8e35311
FC
3305A bug when replacing the glob of a loop variable within the loop has been fixed
3306[perl #21469]. This
3307means the following code will no longer crash:
5076a392 3308
e8e35311
FC
3309 for $x (...) {
3310 *x = *y;
3311 }
5076a392
FC
3312
3313=item *
3314
3315Assigning a glob to a PVLV used to convert it to a plain string. Now it
3316works correctly, and a PVLV can hold a glob. This would happen when a
3317nonexistent hash or array element was passed to a subroutine:
3318
3319 sub { $_[0] = *foo }->($hash{key});
3320 # $_[0] would have been the string "*main::foo"
3321
3322It also happened when a glob was assigned to, or returned from, an element
3323of a tied array or hash [perl #36051].
3324
3325=item *
44691e6f 3326
e8e35311 3327When trying to report C<Use of uninitialized value $Foo::BAR>, crashes could
e262cb24
FC
3328occur if the glob holding the global variable in question had been detached
3329from its original stash by, for example, C<delete $::{'Foo::'}>. This has
3330been fixed by disabling the reporting of variable names in those
e8e35311 3331cases.
44691e6f
AB
3332
3333=item *
3334
e8e35311
FC
3335During the restoration of a localised typeglob on scope exit, any
3336destructors called as a result would be able to see the typeglob in an
3337inconsistent state, containing freed entries, which could result in a
3338crash. This would affect code like this:
3339
3340 local *@;
3341 eval { die bless [] }; # puts an object in $@
3342 sub DESTROY {
3343 local $@; # boom
3344 }
3345
3346Now the glob entries are cleared before any destructors are called. This
3347also means that destructors can vivify entries in the glob. So perl tries
3348again and, if the entries are re-created too many times, dies with a
3349'panic: gp_free...' error message.
3350
3351=back
3352
3353=head2 Unicode
3354
3355=over
44691e6f 3356
5076a392 3357=item *
44691e6f 3358
e8e35311
FC
3359What has become known as the "Unicode Bug" is mostly resolved in this release.
3360Under C<use feature 'unicode_strings'>, the internal storage format of a
3361string no longer affects the external semantics. There are two known
3362exceptions. User-defined case changing functions, which are planned to
3363be deprecated in 5.14, require utf8-encoded strings to function; and the
3364character C<LATIN SMALL LETTER SHARP S> in regular expression
3365case-insensitive matching has a somewhat different set of bugs depending
3366on the internal storage format. Case-insensitive matching of all
3367characters that have multi-character matches, as this one does, is
3368problematical in Perl [perl #58182].
911a3729 3369
5076a392 3370=item *
c8c13991 3371
e8e35311
FC
3372The handling of Unicode non-characters has changed.
3373Previously they were mostly considered illegal, except that only one of
3374the 66 of them was known about in places. The Unicode standard
3375considers them legal, but forbids the "open interchange" of them.
3376This is part of the change to allow the internal use of any code point
3377(see L</Core Enhancements>). Together, these changes resolve
9a5a48b7
FC
3378[perl #38722], [perl #51918], [perl #51936], [perl #63446].
3379
3380=item *
3381
3382Naming a deprecated character in \N{...} no longer leaks memory.
3383
3384=item *
3385
cdc10f43
FC
3386We fixed a bug that could cause \N{} constructs followed by a single . to
3387be parsed incorrectly [perl #74978] (5.12.1).
3388
3389=item *
3390
9a5a48b7
FC
3391C<chop> now correctly handles characters above "\x{7fffffff}"
3392[perl #73246].
3393
3394=item *
3395
3396Passing to C<index> an offset beyond the end of the string when the string
3397is encoded internally in UTF8 no longer causes panics [perl #75898].
3398
3399=item *
3400
3401C<warn()> and C<die()> now respect utf8-encoded scalars [perl #45549].
c8c13991 3402
5076a392
FC
3403=item *
3404
9a5a48b7 3405Sometimes the UTF8 length cache would not be reset on a value
e8e35311 3406returned by substr, causing C<length(substr($uni_string,...))> to give
9a5a48b7
FC
3407wrong answers. With C<${^UTF8CACHE}> set to -1, it would produce a 'panic'
3408error message, too [perl #77692].
e8e35311
FC
3409
3410=back
3411
e9784f55 3412=head2 Ties, Overloading and Other Magic
e8e35311
FC
3413
3414=over
35cdccfc 3415
5076a392
FC
3416=item *
3417
e8e35311 3418Overloading now works properly in conjunction with tied
e9784f55 3419variables. What formerly happened was that most ops checked their
e8e35311
FC
3420arguments for overloading I<before> checking for magic, so for example
3421an overloaded object returned by a tied array access would usually be
e9784f55 3422treated as not overloaded [RT #57012].
911a3729 3423
5076a392 3424=item *
58f55cb3 3425
e9784f55
FC
3426Various cases of magic (e.g., tie methods) being called on tied variables
3427too many or too few times have been fixed:
3428
3429=over
58f55cb3 3430
5076a392 3431=item *
6b3df227 3432
e9784f55 3433FETCH is no longer called on tied variables in void context.
6b3df227 3434
5076a392 3435=item *
c9989a74 3436
e9784f55 3437C<$tied-E<gt>()> did not always call FETCH [perl #8438].
c9989a74 3438
5076a392
FC
3439=item *
3440
e9784f55
FC
3441Filetest operators and C<y///> and C<tr///> were calling FETCH too
3442many times.
b7188eb5
FC
3443
3444=item *
3445
e9784f55
FC
3446The C<=> operator used to ignore magic on its right-hand side if the
3447scalar happened to hold a typeglob (if a typeglob was the last thing
3448returned from or assigned to a tied scalar) [perl #77498].
911a3729 3449
5076a392 3450=item *
c8c13991 3451
e9784f55
FC
3452Dereference operators used to ignore magic if the argument was a
3453reference already (e.g., from a previous FETCH) [perl #72144].
c8c13991 3454
e8e35311 3455=item *
f00d3350 3456
e9784f55
FC
3457C<splice> now calls set-magic (so changes made
3458by C<splice @ISA> are respected by method calls) [perl #78400].
3459
d430b8e7
FC
3460=item *
3461
3462In-memory files created by C<open $fh, 'E<gt>' \$buffer> were not calling
3463FETCH/STORE at all [perl #43789] (5.12.2).
3464
e9784f55 3465=back
c34a735e 3466
5076a392 3467=item *
b7188eb5 3468
e9784f55
FC
3469String C<eval> now detects taintedness of overloaded or tied
3470arguments [perl #75716].
b7188eb5 3471
5076a392 3472=item *
b7188eb5 3473
e9784f55
FC
3474String C<eval> and regular expression matches against objects with string
3475overloading no longer cause memory corruption or crashes [perl 77084].
c34a735e 3476
05dbc6f8
KW
3477=item *
3478
e9784f55
FC
3479L<readline|perlfunc/"readline EXPR"> now honors C<< <> >> overloading on tied
3480arguments.
7b98b857 3481
5076a392 3482=item *
05dbc6f8 3483
e9784f55
FC
3484C<< E<lt>exprE<gt> >> always respects overloading now if the expression is
3485overloaded.
3486
3487Due to the way that 'E<lt>E<gt> as glob' was parsed differently from
3488'E<lt>E<gt> as filehandle' from 5.6 onwards, something like C<< E<lt>$foo[0]E<gt> >> did
3489not handle overloading, even if C<$foo[0]> was an overloaded object. This
3490was contrary to the documentation for overload, and meant that C<< E<lt>E<gt> >>
3491could not be used as a general overloaded iterator operator.
05dbc6f8
KW
3492
3493=item *
3494
e8e35311
FC
3495The fallback behaviour of overloading on binary operators was asymmetric
3496[perl #71286].
05dbc6f8 3497
5076a392 3498=item *
05dbc6f8 3499
e9784f55
FC
3500Magic applied to variables in the main package no longer affects other packages.
3501See L</Magic variables outside the main package> above [perl #76138].
05dbc6f8 3502
5076a392 3503=item *
05dbc6f8 3504
e9784f55
FC
3505Sometimes magic (ties, taintedness, etc.) attached to variables could cause
3506an object to last longer than it should, or cause a crash if a tied
3507variable were freed from within a tie method. These have been fixed
3508[perl #81230].
05dbc6f8
KW
3509
3510=item *
3511
e8e35311
FC
3512DESTROY methods of objects implementing ties are no longer able to crash by
3513accessing the tied variable through a weak reference [perl #86328].
3514
2c389f6c
FC
3515=item *
3516
3517Fixed a regression of kill() when a match variable is used for the
3518process ID to kill [perl #75812].
3519
3520=item *
3521
3522C<$AUTOLOAD> used to remain tainted forever if it ever became tainted. Now
3523it is correctly untainted if an autoloaded method is called and the method
3524name was not tainted.
3525
3526=item *
3527
3528C<sprintf> now dies when passed a tainted scalar for the format. It did
3529already die for arbitrary expressions, but not for simple scalars
3530[perl #82250].
3531
cdc10f43
FC
3532=item *
3533
3534utf8::is_utf8 now respects get-magic (e.g. $1) (5.12.1).
3535
e8e35311
FC
3536=back
3537
3538=head2 The Debugger
3539
3540=over
05dbc6f8 3541
5076a392 3542=item *
05dbc6f8 3543
bdb0cce8 3544The Perl debugger now also works in taint mode [perl #76872].
4d56cd4f 3545
5076a392
FC
3546=item *
3547
bdb0cce8 3548Subroutine redefinition works once more in the debugger [perl #48332].
05dbc6f8 3549
911a3729
FC
3550=item *
3551
e8e35311 3552When C<-d> is used on the shebang (C<#!>) line, the debugger now has access
bdb0cce8 3553to the lines of the main program. In the past, this sometimes worked and
e8e35311
FC
3554sometimes did not, depending on what order things happened to be arranged
3555in memory [perl #71806].
911a3729 3556
5076a392 3557=item *
44691e6f 3558
bdb0cce8 3559A possible memory leak when using L<caller()|perlfunc/"caller EXPR"> to set
d430b8e7 3560C<@DB::args> has been fixed (5.12.2).
bdb0cce8
FC
3561
3562=item *
3563
3564Perl no longer stomps on $DB::single, $DB::trace and $DB::signal if they
3565already have values when $^P is assigned to [perl #72422].
44691e6f 3566
5076a392 3567=item *
44691e6f 3568
e8e35311
FC
3569C<#line> directives in string evals were not properly updating the arrays
3570of lines of code (C<< @{"_<..."} >>) that the debugger (or any debugging or
3571profiling module) uses. In threaded builds, they were not being updated at
3572all. In non-threaded builds, the line number was ignored, so any change to
3573the existing line number would cause the lines to be misnumbered
3574[perl #79442].
3575
3576=back
3577
2c389f6c 3578=head2 Threads
e8e35311
FC
3579
3580=over
9dc513c5 3581
5076a392
FC
3582=item *
3583
2c389f6c
FC
3584Perl no longer accidentally clones lexicals in scope within active stack
3585frames in the parent when creating a child thread [perl #73086].
44691e6f 3586
5076a392 3587=item *
6d96b0fe 3588
e8e35311
FC
3589Several memory leaks in cloning and freeing threaded Perl interpreters have been
3590fixed [perl #77352].
6d96b0fe 3591
5076a392 3592=item *
6d96b0fe 3593
e8e35311
FC
3594Creating a new thread when directory handles were open used to cause a
3595crash, because the handles were not cloned, but simply passed to the new
3596thread, resulting in a double free.
3597
3598Now directory handles are cloned properly, on systems that have a C<fchdir>
3599function. On other systems, new threads simply do not inherit directory
3600handles from their parent threads [perl #75154].
6d96b0fe 3601
5076a392 3602=item *
b7188eb5 3603
e8e35311
FC
3604The typeglob C<*,>, which holds the scalar variable C<$,> (output field
3605separator), had the wrong reference count in child threads.
b7188eb5 3606
5076a392 3607=item *
b7188eb5 3608
e8e35311
FC
3609[perl #78494] When pipes are shared between threads, the C<close> function
3610(and any implicit close, such as on thread exit) no longer blocks.
3611
2c389f6c
FC
3612=item *
3613
3614Perl now does a timely cleanup of SVs that are cloned into a new thread but
3615then discovered to be orphaned (i.e., their owners are I<not> cloned). This
3616eliminates several "scalars leaked" warnings when joining threads.
3617
e8e35311
FC
3618=back
3619
2c389f6c 3620=head2 Scoping and Subroutines
e8e35311
FC
3621
3622=over
44691e6f 3623
5076a392 3624=item *
44691e6f 3625
2c389f6c 3626Lvalue subroutines are again able to return copy-on-write scalars. This
5a553547 3627had been broken since version 5.10.0 [perl #75656] (5.12.2).
44691e6f 3628
5076a392 3629=item *
44691e6f 3630
2c389f6c
FC
3631C<require> no longer causes C<caller> to return the wrong file name for
3632the scope that called C<require> and other scopes higher up that had the
3633same file name [perl #68712].
44691e6f 3634
5076a392 3635=item *
b7188eb5 3636
2c389f6c
FC
3637C<sort> with a ($$)-prototyped comparison routine used to cause the value
3638of @_ to leak out of the sort. Taking a reference to @_ within the
3639sorting routine could cause a crash [perl #72334].
b7188eb5 3640
5076a392 3641=item *
b7188eb5 3642
2c389f6c
FC
3643Match variables (e.g., C<$1>) no longer persist between calls to a sort
3644subroutine [perl #76026].
b7188eb5 3645
5076a392 3646=item *
44691e6f 3647
2c389f6c
FC
3648Iterating with C<foreach> over an array returned by an lvalue sub now works
3649[perl #23790].
6c9cd4a1 3650
5076a392 3651=item *
6c9cd4a1 3652
2c389f6c
FC
3653C<$@> is now localised during calls to C<binmode> to prevent action at a
3654distance [perl #78844].
44691e6f 3655
5076a392 3656=item *
44691e6f 3657
2c389f6c
FC
3658Calling a closure prototype (what is passed to an attribute handler for a
3659closure) now results in a "Closure prototype called" error message instead
3660of a crash [perl #68560].
44691e6f 3661
5076a392 3662=item *
44691e6f 3663
2c389f6c
FC
3664Mentioning a read-only lexical variable from the enclosing scope in a
3665string C<eval> no longer causes the variable to become writable
3666[perl #19135].
3667
3668=back
3669
3670=head2 Signals
3671
3672=over
b7188eb5
FC
3673
3674=item *
3675
2c389f6c 3676Within signal handlers, C<$!> is now implicitly localized.
b7188eb5 3677
5076a392 3678=item *
b7188eb5 3679
2c389f6c
FC
3680CHLD signals are no longer unblocked after a signal handler is called if
3681they were blocked before by C<POSIX::sigprocmask> [perl #82040].
b7188eb5 3682
5076a392 3683=item *
b7188eb5 3684
2c389f6c
FC
3685A signal handler called within a signal handler could cause leaks or
3686double-frees. Now fixed. [perl #76248].
b7188eb5 3687
e8e35311 3688=back
5076a392 3689
2c389f6c 3690=head2 Miscellaneous Memory Leaks
e8e35311
FC
3691
3692=over
b7188eb5
FC
3693
3694=item *
3695
d430b8e7 3696Several memory leaks when loading XS modules were fixed (5.12.2).
5076a392
FC
3697
3698=item *
3699
2c389f6c
FC
3700L<substr()|perlfunc/"substr EXPR,OFFSET,LENGTH,REPLACEMENT">,
3701L<pos()|perlfunc/"index STR,SUBSTR,POSITION">, L<keys()|perlfunc/"keys HASH">,
3702and L<vec()|perlfunc/"vec EXPR,OFFSET,BITS"> could, when used in combination
3703with lvalues, result in leaking the scalar value they operate on, and cause its
3704destruction to happen too late. This has now been fixed.
5076a392
FC
3705
3706=item *
3707
2c389f6c
FC
3708The postincrement and postdecrement operators, C<++> and C<-->, used to cause
3709leaks when being used on references. This has now been fixed.
5076a392
FC
3710
3711=item *
3712
2c389f6c
FC
3713Nested C<map> and C<grep> blocks no longer leak memory when processing
3714large lists [perl #48004].
5076a392
FC
3715
3716=item *
3717
d430b8e7 3718C<use I<VERSION>> and C<no I<VERSION>> no longer leak memory [perl #78436]
2c389f6c 3719[perl #69050].
5076a392 3720
2c389f6c 3721=item *
5076a392 3722
2c389f6c
FC
3723C<.=> followed by C<< <> >> or C<readline> would leak memory if C<$/>
3724contained characters beyond the octet range and the scalar assigned to
3725happened to be encoded as UTF8 internally [perl #72246].
5076a392
FC
3726
3727=item *
3728
2c389f6c 3729C<eval "BEGIN{die}"> no longer leaks memory on non-threaded builds.
5076a392 3730
2c389f6c 3731=back
e8e35311 3732
2c389f6c
FC
3733=head2 Memory Corruption and Crashes
3734
3735=over
5076a392
FC
3736
3737=item *
3738
2c389f6c 3739glob() no longer crashes when %File::Glob:: is empty and
d430b8e7 3740CORE::GLOBAL::glob isn't present [perl #75464] (5.12.2).
5076a392 3741
e8e35311
FC
3742=item *
3743
2c389f6c
FC
3744readline() has been fixed when interrupted by signals so it no longer
3745returns the "same thing" as before or random memory.
5076a392
FC
3746
3747=item *
3748
2c389f6c
FC
3749When assigning a list with duplicated keys to a hash, the assignment used to
3750return garbage and/or freed values:
3751
3752 @a = %h = (list with some duplicate keys);
3753
3754This has now been fixed [perl #31865].
5076a392 3755
e8e35311 3756=item *
5076a392 3757
e8e35311
FC
3758The mechanism for freeing objects in globs used to leave dangling
3759pointers to freed SVs, meaning Perl users could see corrupted state
3760during destruction.
5076a392 3761
e8e35311 3762Perl now only frees the affected slots of the GV, rather than freeing
2c389f6c 3763the GV itself. This makes sure that there are no dangling refs or
e8e35311 3764corrupted state during destruction.
5076a392
FC
3765
3766=item *
3767
2c389f6c
FC
3768The interpreter no longer crashes when freeing deeply-nested arrays of
3769arrays. Hashes have not been fixed yet [perl #44225].
5076a392
FC
3770
3771=item *
3772
e8e35311
FC
3773Concatenating long strings under C<use encoding> no longer causes perl to
3774crash [perl #78674].
5076a392
FC
3775
3776=item *
3777
e8e35311
FC
3778Calling C<< ->import >> on a class lacking an import method could corrupt
3779the stack, resulting in strange behaviour. For instance,
3780
3781 push @a, "foo", $b = bar->import;
3782
3783would assign 'foo' to C<$b> [perl #63790].
5076a392
FC
3784
3785=item *
3786
e8e35311
FC
3787The C<recv> function could crash when called with the MSG_TRUNC flag
3788[perl #75082].
5076a392
FC
3789
3790=item *
3791
e8e35311
FC
3792C<formline> no longer crashes when passed a tainted format picture. It also
3793taints C<$^A> now if its arguments are tainted [perl #79138].
5076a392 3794
cdc10f43
FC
3795=item *
3796
3797A bug in how we process filetest operations could cause a segfault.
3798Filetests don't always expect an op on the stack, so we now use
3799TOPs only if we're sure that we're not stat'ing the _ filehandle.
3800This is indicated by OPf_KIDS (as checked in ck_ftst) [perl #74542]
3801(5.12.1).
3802
d430b8e7
FC
3803=item *
3804
3805C<unpack()> now handles scalar context correctly for C<%32H> and C<%32u>,
3806fixing a potential crash. C<split()> would crash because the third item
3807on the stack wasn't the regular expression it expected. C<unpack("%2H",
3808...)> would return both the unpacked result and the checksum on the stack,
3809as would C<unpack("%2u", ...)> [perl #73814] (5.12.2).
3810
2c389f6c 3811=back
5076a392 3812
2c389f6c 3813=head2 Fixes to Various Perl Operators
5076a392 3814
2c389f6c 3815=over
5076a392
FC
3816
3817=item *
3818
2c389f6c
FC
3819The C<&> C<|> C<^> bitwise operators no longer coerce read-only arguments
3820[perl #20661].
5076a392
FC
3821
3822=item *
3823
2c389f6c
FC
3824Stringifying a scalar containing -0.0 no longer has the affect of turning
3825false into true [perl #45133].
5076a392 3826
e8e35311
FC
3827=item *
3828
3829Some numeric operators were converting integers to floating point,
3830resulting in loss of precision on 64-bit platforms [perl #77456].
5076a392
FC
3831
3832=item *
3833
2c389f6c
FC
3834C<sprintf> was ignoring locales when called with constant arguments
3835[perl #78632].
e8e35311
FC
3836
3837=item *
3838
2c389f6c
FC
3839Combining the vector (%v) flag and dynamic precision would
3840cause sprintf to confuse the order of its arguments, making it treat the
3841string as the precision and vice versa [perl #83194].
1e463951 3842
c71a852f 3843=back
b7188eb5 3844
42a91c97
FC
3845=head2 Bugs Relating to the C API
3846
3847=over
3848
3849=item *
3850
3851The C-level C<lex_stuff_pvn> function would sometimes cause a spurious
3852syntax error on the last line of the file if it lacked a final semicolon
cdc10f43 3853[perl #74006] (5.12.1).
42a91c97
FC
3854
3855=item *
3856
3857The C<eval_sv> and C<eval_pv> C functions now set C<$@> correctly when
3858there is a syntax error and no C<G_KEEPERR> flag, and never set it if the
3859C<G_KEEPERR> flag is present [perl #3719].
3860
3861=item *
3862
3863The XS multicall API no longer causes subroutines to lose reference counts
3864if called via the multicall interface from within those very subroutines.
3865This affects modules like List::Util. Calling one of its functions with an
3866active subroutine as the first argument could cause a crash [perl #78070].
3867
3868=item *
3869
3870The C<SvPVbyte> function available to XS modules now calls magic before
3871downgrading the SV, to avoid warnings about wide characters [perl #72398].
3872
3873=item *
3874
3875The ref types in the typemap for XS bindings now support magical variables
3876[perl #72684].
3877
3878=item *
3879
3880C<sv_catsv_flags> no longer calls C<mg_get> on its second argument (the
3881source string) if the flags passed to it do not include SV_GMAGIC. So it
3882now matches the documentation.
3883
2c389f6c
FC
3884=item *
3885
3886C<my_strftime> no longer leaks memory. This fixes a memory leak in
3887C<POSIX::strftime> [perl #73520].
3888
cdc10f43
FC
3889=item *
3890
3891XSUB.h now correctly redefines fgets under PERL_IMPLICIT_SYS [perl #55049]
3892(5.12.1).
3893
3894=item *
3895
3896XS code using C<fputc()> or C<fputs()>: on Windows could cause an error
3897due to their arguments being swapped [perl #72704] (5.12.1).
3898
d430b8e7
FC
3899=item *
3900
3901A possible segfault in the C<T_PRTOBJ> default typemap has been fixed
3902(5.12.2).
3903
3904=item *
3905
3906A bug that could cause "Unknown error" messages when
3907C<call_sv(code, G_EVAL)> is called from an XS destructor has been fixed
3908(5.12.2).
3909
42a91c97
FC
3910=back
3911
c71a852f 3912=head1 Known Problems
44691e6f 3913
7d43ecd2
FC
3914XXX Many of these have probably already been solved. There are also
3915unresolved BBC articles linked to #77718 that are awaiting CPAN
3916releases. These may need to be listed here.
3917
5076a392 3918=over 4
994ae753 3919
5076a392 3920=item *
994ae753 3921
cdc10f43
FC
3922C<List::Util::first> misbehaves in the presence of a lexical C<$_>
3923(typically introduced by C<my $_> or implicitly by C<given>). The variable
3924which gets set for each iteration is the package variable C<$_>, not the
3925lexical C<$_>.
3926
3927A similar issue may occur in other modules that provide functions which
3928take a block as their first argument, like
3929
3930 foo { ... $_ ...} list
3931
3932See also: L<http://rt.perl.org/rt3/Public/Bug/Display.html?id=67694>
3933
3934=item *
3935
5076a392
FC
3936readline() returns an empty string instead of undef when it is
3937interrupted by a signal
c094a73d 3938
ca767864
JD
3939=item *
3940
5076a392
FC
3941Test-Harness was updated from 3.17 to 3.21 for this release. A rewrite
3942in how it handles non-Perl tests (in 3.17_01) broke argument passing to
3943non-Perl tests with L<prove> (RT #59186), and required that non-Perl
3944tests be run as C<prove ./test.sh> instead of C<prove test.sh> These
3945issues are being solved upstream, but didn't make it into this release.
3946They're expected to be fixed in time for perl v5.13.4. (RT #59457)
3947
3948=item *
3949
3950C<version> now prevents object methods from being called as class methods
3951(d808b68)
3952
3953=item *
3954
3955The changes in L<substr()|perlfunc/"substr EXPR,OFFSET,LENGTH,REPLACEMENT">
3956broke C<HTML::Parser> <= 3.66. A fixed C<HTML::Parser> is available as versions
39573.67 on CPAN.
3958
3959=item *
3960
3961The changes in prototype handling break C<Switch>. A patch has been sent
3962upstream and will hopefully appear on CPAN soon.
3963
3964=item *
3965
3966The upgrade to Encode-2.40 has caused some tests in the libwww-perl distribution
3967on CPAN to fail. (Specifically, F<base/message-charset.t> tests 33-36 in version
39685.836 of that distribution now fail.)
3969
3970=item *
3971
3972The upgrade to ExtUtils-MakeMaker-6.57_05 has caused some tests in the
3973Module-Install distribution on CPAN to fail. (Specifically, F<02_mymeta.t> tests
39745 and 21, F<18_all_from.t> tests 6 and 15, F<19_authors.t> tests 5, 13, 21 and
397529, and F<20_authors_with_special_characters.t> tests 6, 15 and 23 in version
39761.00 of that distribution now fail.)
ca767864 3977
c71a852f 3978=back
014fb485 3979
5076a392
FC
3980=head1 Errata
3981
c21445df 3982=head2 C<keys>, C<values> and C<each> work on arrays
df91d470
FC
3983
3984You can now use the C<keys>, C<values>, C<each> builtin functions on arrays
3985(previously you could only use them on hashes). See L<perlfunc> for details.
3986This is actually a change introduced in perl 5.12.0, but it was missed from
3987that release's perldelta.
5076a392 3988
c71a852f 3989=head1 Obituary
014fb485 3990
5076a392
FC
3991Randy Kobes, creator of the kobesearch alternative to search.cpan.org and
3992contributor/maintainer to several core Perl toolchain modules, passed away
3993on September 18, 2010 after a battle with lung cancer. His contributions
3994to the Perl community will be missed.
44691e6f 3995
44691e6f
AB
3996=head1 Acknowledgements
3997
c71a852f 3998XXX The list of people to thank goes here.
44691e6f
AB
3999
4000=head1 Reporting Bugs
4001
4002If you find what you think is a bug, you might check the articles
4003recently posted to the comp.lang.perl.misc newsgroup and the perl
4004bug database at http://rt.perl.org/perlbug/ . There may also be
4005information at http://www.perl.org/ , the Perl Home Page.
4006
4007If you believe you have an unreported bug, please run the L<perlbug>
4008program included with your release. Be sure to trim your bug down
4009to a tiny but sufficient test case. Your bug report, along with the
4010output of C<perl -V>, will be sent off to perlbug@perl.org to be
4011analysed by the Perl porting team.
4012
4013If the bug you are reporting has security implications, which make it
4014inappropriate to send to a publicly archived mailing list, then please send
4015it to perl5-security-report@perl.org. This points to a closed subscription
4016unarchived mailing list, which includes all the core committers, who be able
4017to help assess the impact of issues, figure out a resolution, and help
4018co-ordinate the release of patches to mitigate or fix the problem across all
4019platforms on which Perl is supported. Please only use this address for
4020security issues in the Perl core, not for modules independently
4021distributed on CPAN.
4022
4023=head1 SEE ALSO
4024
4025The F<Changes> file for an explanation of how to view exhaustive details
4026on what changed.
4027
4028The F<INSTALL> file for how to build Perl.
4029
4030The F<README> file for general stuff.
4031
4032The F<Artistic> and F<Copying> files for copyright information.
4033
4034=cut