This is a live mirror of the Perl 5 development currently hosted at https://github.com/perl/perl5
Various perldelta consistency edits and other cleanup
[perl5.git] / pod / perl5113delta.pod
CommitLineData
2e8102e6
LB
1=head1 NAME
2
3[ this is a template for a new perldelta file. Any text flagged as
4XXX needs to be processed before release. ]
5
6perldelta - what is new for perl v5.11.3
7
8=head1 DESCRIPTION
9
166777da 10This document describes differences between the 5.11.2 release and
2e8102e6
LB
11the 5.11.3 release.
12
13If you are upgrading from an earlier release such as 5.11.3, first read
14the L<perl5XXXdelta>, which describes differences between 5.11.3 and
155.10.0
16
17=head1 Notice
18
19XXX Any important notices here
20
21=head1 Incompatible Changes
22
1f5724d9 23=over
2e8102e6 24
1f5724d9
NC
25=item Filehandles are blessed directly into C<IO::Handle::>, as C<FileHandle> is merely a wrapper around C<IO::Handle>.
26
db2ed548
DG
27XXX Some description of why this change was made would be nice -- e.g. what
28the benefit that justifies the incompatibility -- dagolden, 2009-12-20
29
1f5724d9 30=back
2e8102e6
LB
31
32=head1 Core Enhancements
33
34XXX New core language features go here. Summarise user-visible core language
35enhancements. Particularly prominent performance optimisations could go
36here, but most should go in the L</Performance Enhancements> section.
37
283b82dc
KW
38=head2 Unicode version
39
40Perl is shipped with the latest Unicode version, 5.2, October 2009. See
41L<http://www.unicode.org/versions/Unicode5.2.0> for details about this release
db2ed548
DG
42of Unicode. See L<perlunicode> for instructions on installing and using
43older versions of Unicode.
37e2e78e 44
8d814567
RGS
45=head2 Unicode properties
46
47Perl can now handle every Unicode character property. A new pod,
48L<perluniprops>, lists all available non-Unihan character properties. By
49default the Unihan properties and certain others (deprecated and Unicode
50internal-only ones) are not exposed. See below for more details on
51these; there is also a section in the pod listing them, and why they are
52not exposed.
53
54Perl now fully supports the Unicode compound-style of using C<=> and C<:>
55in writing regular expressions: C<\p{property=value}> and
56C<\p{property:value}> (both of which mean the same thing).
57
db2ed548 58Perl now fully supports the Unicode loose matching rules for text
8d814567
RGS
59between the braces in C<\p{...}> constructs. In addition, Perl also allows
60underscores between digits of numbers.
61
62All the Unicode-defined synonyms for properties and property values are
63now accepted.
64
37e2e78e
KW
65C<qr/\X/>, which matches a Unicode logical character, has been expanded to work
66better with various Asian languages. It now is defined as an C<extended
67grapheme cluster>. (See L<http://www.unicode.org/reports/tr29/>). One change
68due to this is that C<\X> will match the whole sequence C<S<CR LF>>. Another
69change is that C<\X> will match an isolated mark. Marks generally come after a
70base character, but it is possible in Unicode to have them in isolation, and
71C<\X> will now handle that case. Otherwise, this change should be transparent
db2ed548 72for non-affected languages.
37e2e78e 73
8d814567
RGS
74C<\p{...}> matches using the Canonical_Combining_Class property were
75completely broken in previous Perls. This is now fixed.
76
77In previous Perls, the Unicode Decomposition_Type=Compat property and a
78Perl extension had the same name, which led to neither matching all the
79correct values (with more than 100 mistakes in one, and several thousand
80in the other). The Perl extension has now been renamed to be
81Decomposition_Type=Noncanonical (short: dt=noncanon). It has the same
82meaning as was previously intended, namely the union of all the
83non-canonical Decomposition types, with Unicode Compat being just one of
84those.
85
86C<\p{Uppercase}> and C<\p{Lowercase}> have been brought into line with the
87Unicode definitions. This means they each match a few more characters
88than previously.
89
90C<\p{Cntrl}> now matches the same characters as C<\p{Control}>. This means it
91no longer will match Private Use (gc=co), Surrogates (gc=cs), nor Format
92(gc=cf) code points. The Format code points represent the biggest
93possible problem. All but 36 of them are either officially deprecated
94or strongly discouraged from being used. Of those 36, likely the most
95widely used are the soft hyphen (U+00AD), and BOM, ZWSP, ZWNJ, WJ, and
96similar, plus Bi-directional controls.
97
98C<\p{Alpha}> now matches the same characters as C<\p{Alphabetic}>. The Perl
99definition included a number of things that aren't really alpha (all
100marks), while omitting many that were. The Unicode definition is
101clearly better, so we are switching to it. As a direct consequence, the
102definitions of C<\p{Alnum}> and C<\p{Word}> which depend on Alpha also change.
103
104C<\p{Word}> also now doesn't match certain characters it wasn't supposed
105to, such as fractions.
106
107C<\p{Print}> no longer matches the line control characters: tab, lf, cr,
108ff, vt, and nel. This brings it in line with the documentation.
109
db2ed548 110C<\p{Decomposition_Type=Canonical}> now includes the Hangul syllables
8d814567
RGS
111
112The Numeric type property has been extended to include the Unihan
113characters.
114
115There is a new Perl extension, the 'Present_In', or simply 'In'
116property. This is an extension of the Unicode Age property, but
117C<\p{In=5.0}> matches any code point whose usage has been determined as of
118Unicode version 5.0. The C<\p{Age=5.0}> only matches code points added in 5.0.
119
120A number of properties did not have the correct values for unassigned
121code points. This is now fixed. The affected properties are
122Bidi_Class, East_Asian_Width, Joining_Type, Decomposition_Type,
123Hangul_Syllable_Type, Numeric_Type, and Line_Break.
124
125The Default_Ignorable_Code_Point, ID_Continue, and ID_Start properties
126have been updated to their current definitions.
127
128Certain properties that are supposed to be Unicode internal-only were
129erroneously exposed by previous Perls. Use of these in regular
130expressions will now generate a deprecated warning message, if those
131warnings are enabled. The properties are: Other_Alphabetic,
132Other_Default_Ignorable_Code_Point, Other_Grapheme_Extend,
133Other_ID_Continue, Other_ID_Start, Other_Lowercase, Other_Math, and
134Other_Uppercase.
135
8d814567
RGS
136An installation can now fairly easily change which Unicode properties
137Perl understands. As mentioned above, certain properties are by default
138turned off. These include all the Unihan properties (which should be
139accessible via the CPAN module Unicode::Unihan) and any deprecated or
140Unicode internal-only property that Perl has never exposed.
141
db2ed548
DG
142XXX what does "files in the To directory" mean? -- dagolden, 2009-12-20
143
8d814567
RGS
144The files in the To directory are now more clearly marked as being
145stable, directly usable by applications. New hash entries in them give
146the format of the normal entries which allows for easier machine
147parsing. Perl can generate files in this directory for any property,
148though most are suppressed. An installation can choose to change which
149get written. Instructions are in L<perluniprops>.
150
2e8102e6
LB
151=head1 New Platforms
152
153XXX List any platforms that this version of perl compiles on, that previous
154versions did not. These will either be enabled by new files in the F<hints/>
155directories, or new subdirectories and F<README> files at the top level of the
156source tree.
157
158=head1 Modules and Pragmata
159
160XXX All changes to installed files in F<cpan/>, F<dist/>, F<ext/> and F<lib/>
161go here, in a list ordered by distribution name. Minimally it should be the
162module version, but it's more useful to the end user to give a paragraph's
163summary of the module's changes. In an ideal world, dual-life modules would
164have a F<Changes> file that could be cribbed.
165
166=head2 New Modules and Pragmata
167
168=over 4
169
2e8102e6
LB
170XXX
171
172=back
173
174=head2 Pragmata Changes
175
176=over 4
177
db2ed548
DG
178=item C<feature>
179
180Upgraded from 1.13 to 1.14. Added the C<unicode_strings> feature:
181
182 use feature "unicode_strings";
ecb37473 183
f43e267d 184This pragma turns on Unicode semantics for the case-changing operations
db2ed548
DG
185(uc/lc/ucfirst/lcfirst) on strings that don't have the internal UTF-8 flag set,
186but that contain single-byte characters between 128 and 255.
ecb37473 187
f43e267d 188=item C<legacy>
2e8102e6 189
f43e267d 190The experimental C<legacy> pragma, introduced in 5.11.2, has been removed,
db2ed548 191and its functionality replaced by the new feature pragma, C<use feature
f43e267d 192"unicode_strings">.
2e8102e6 193
db2ed548 194=item C<warnings>
2e8102e6 195
db2ed548 196Upgraded from 1.07 to 1.08. Added new C<warnings::fatal_enabled()> function.
09b2a3d2 197
db2ed548 198=back
09b2a3d2 199
db2ed548 200=head2 Updated Modules
09b2a3d2 201
db2ed548
DG
202XXX This should be generated with Porting/corelist-perldelta.pl once
203Module::Corelist is updated for 5.011003.
2e8102e6
LB
204
205=head1 Utility Changes
206
207XXX Changes to installed programs such as F<perlbug> and F<xsubpp> go
208here. Most of these are built within the directories F<utils> and F<x2p>.
209
210=over 4
211
db2ed548 212=item F<perlbug>
2e8102e6 213
db2ed548 214No longer reports "Message sent" when it hasn't actually sent the message
1f5724d9 215
2e8102e6
LB
216=back
217
218=head1 New Documentation
219
220XXX Changes which create B<new> files in F<pod/> go here.
221
222=over 4
223
224=item L<XXX>
225
226XXX
227
228=back
229
230=head1 Changes to Existing Documentation
231
232XXX Changes which significantly change existing files in F<pod/> go here.
233Any changes to F<pod/perldiag.pod> should go in L</New or Changed Diagnostics>.
234
235
9c455b5f
RS
236The Pod specification (L<perlpodspec>) has been updated to bring the
237specification in line with modern usage already supported by most Pod systems.
238A parameter string may now follow the format name in a "begin/end" region.
1f5724d9
NC
239Links to URIs with a text description are now allowed. The usage of
240C<LE<lt>"section"E<gt>> has been marked as deprecated.
9c455b5f
RS
241
242L<if.pm|if> has been documented in L<perlfunc/use> as a means to get
243conditional loading of modules despite the implicit BEGIN block around C<use>.
874e3373
JV
244
245
246
2e8102e6
LB
247=head1 Performance Enhancements
248
249XXX Changes which enhance performance without changing behaviour go here. There
250may well be none in a stable release.
251
252=over 4
253
254=item *
255
256XXX
257
258=back
259
260=head1 Installation and Configuration Improvements
261
262XXX Changes to F<Configure>, F<installperl>, F<installman>, and analogous tools
263go here.
264
265=head2 Configuration improvements
266
267XXX
268
269=head2 Compilation improvements
270
874e3373 271 Make distclean work again
2e8102e6
LB
272XXX
273
ecb37473
JV
274=head2 Testing improvements
275
276=over 4
277
278=item It's now possible to override C<PERL5OPT> and friends in F<t/TEST>
279
280=back
281
2e8102e6
LB
282=head2 Platform Specific Changes
283
284=over 4
285
874e3373 286=item Win32
2e8102e6 287
db2ed548 288=over 4
ecb37473
JV
289
290=item *
291
292Always add a manifest resource to C<perl.exe> to specify the <trustInfo>
293settings for Windows Vista and later. Without this setting Windows
294will treat C<perl.exe> as a legacy application and apply various
295heuristics like redirecting access to protected file system areas
296(like the "Program Files" folder) to the users "VirtualStore"
297instead of generating a proper "permission denied" error.
298
299For VC8 and VC9 this manifest setting is automatically generated by
300the compiler/linker (together with the binding information for their
301respective runtime libraries); for all other compilers we need to
302embed the manifest resource explicitly in the external resource file.
303
304This change also requests the Microsoft Common-Controls version 6.0
305(themed controls introduced in Windows XP) via the dependency list
306in the assembly manifest. For VC8 and VC9 this is specified using the
307C</manifestdependency> linker commandline option instead.
308
309=back
310
311=item cygwin
312
313=over 4
314
315=item Enable IPv6 support on cygwin 1.7 and newer
316
317=back
874e3373
JV
318
319=item OpenVMS
2e8102e6 320
ecb37473
JV
321=over 4
322
323=item Make -UDEBUGGING the default on VMS for 5.12.0.
324
325Like it has been everywhere else for ages and ages. Also make
326command-line selection of -UDEBUGGING and -DDEBUGGING work in
327configure.com; before the only way to turn it off was by saying
328no in answer to the interactive question.
329
2e8102e6
LB
330=back
331
1f5724d9
NC
332=back
333
2e8102e6
LB
334=head1 Selected Bug Fixes
335
336XXX Important bug fixes in the core language are summarised here.
337Bug fixes in files in F<ext/> and F<lib/> are best summarised in
338L</Modules and Pragmata>.
339
340=over 4
341
342=item *
343
ecb37473
JV
344Ensure that pp_qr returns a new regexp SV each time. Resolves RT #69852.
345
346Instead of returning a(nother) reference to the (pre-compiled) regexp in the
347optree, use reg_temp_copy() to create a copy of it, and return a reference to
348that. This resolves issues about Regexp::DESTROY not being called in a timely
349fashion (the original bug tracked by RT #69852), as well as bugs related to
350blessing regexps, and of assigning to regexps, as described in correspondence
351added to the ticket.
352
353It transpires that we also need to undo the SvPVX() sharing when ithreads
354cloning a Regexp SV, because mother_re is set to NULL, instead of a cloned
355copy of the mother_re. This change might fix bugs with regexps and threads in
356certain other situations, but as yet neither tests nor bug reports have
357indicated any problems, so it might not actually be an edge case that it's
358possible to reach.
359
360=item *
361
362Several compilation errors and segfaults when perl was built with C<-Dmad> were fixed.
363
364=item *
365
366Fixes for lexer API changes in 5.11.2 which broke NYTProf's savesrc option.
2e8102e6
LB
367
368=back
369
370=head1 New or Changed Diagnostics
371
372XXX New or changed warnings emitted by the core's C<C> code go here.
373
374=over 4
375
376=item C<XXX>
377
874e3373 378 Make split warn in void context
2e8102e6
LB
379XXX
380
381=back
382
383=head1 Changed Internals
384
385XXX Changes which affect the interface available to C<XS> code go here.
386
387=over 4
388
389=item *
390
391XXX
392
393=back
394
395=head1 New Tests
396
397XXX Changes which create B<new> files in F<t/> go here. Changes to
398existing files in F<t/> aren't worth summarising, although the bugs that
399they represent may be.
400
401=over 4
402
403=item F<XXX>
404
405XXX
406
407=back
408
409=head1 Known Problems
410
411XXX Descriptions of platform agnostic bugs we know we can't fix go here. Any
412tests that had to be C<TODO>ed for the release would be noted here, unless
413they were specific to a particular platform (see below).
414
415This is a list of some significant unfixed bugs, which are regressions
416from either 5.11.3 or 5.11.3.
417
418=over 4
419
420=item *
421
422XXX
423
424=back
425
426=head1 Deprecations
427
428XXX Add any new known deprecations here.
429
430The following items are now deprecated.
431
432=over 4
433
13a4a486 434=item Use of "goto" to jump into a construct is deprecated
2e8102e6 435
13a4a486
RGS
436Using C<goto> to jump from an outer scope into an inner
437scope is now deprecated. This rare use case was causing
438problems in the implementation of scopes.
2e8102e6
LB
439
440=back
441
442=head1 Platform Specific Notes
443
444XXX Any changes specific to a particular platform. VMS and Win32 are the usual
445stars here. It's probably best to group changes under the same section layout
446as the main perldelta
447
448=head1 Obituary
449
450XXX If any significant core contributor has died, we've added a short obituary
451here.
452
453=head1 Acknowledgements
454
455XXX The list of people to thank goes here.
456
457
458=head1 Reporting Bugs
459
460If you find what you think is a bug, you might check the articles
461recently posted to the comp.lang.perl.misc newsgroup and the perl
462bug database at http://rt.perl.org/perlbug/ . There may also be
463information at http://www.perl.org/ , the Perl Home Page.
464
465If you believe you have an unreported bug, please run the B<perlbug>
466program included with your release. Be sure to trim your bug down
467to a tiny but sufficient test case. Your bug report, along with the
468output of C<perl -V>, will be sent off to perlbug@perl.org to be
469analysed by the Perl porting team.
470
471If the bug you are reporting has security implications, which make it
472inappropriate to send to a publicly archived mailing list, then please send
473it to perl5-security-report@perl.org. This points to a closed subscription
474unarchived mailing list, which includes all the core committers, who be able
475to help assess the impact of issues, figure out a resolution, and help
476co-ordinate the release of patches to mitigate or fix the problem across all
477platforms on which Perl is supported. Please only use this address for
478security issues in the Perl core, not for modules independently
479distributed on CPAN.
480
481=head1 SEE ALSO
482
483The F<Changes> file for an explanation of how to view exhaustive details
484on what changed.
485
486The F<INSTALL> file for how to build Perl.
487
488The F<README> file for general stuff.
489
490The F<Artistic> and F<Copying> files for copyright information.
491
492=cut
7ef88767
JV
493
494
495
496
497All changes through commit b4178430270dbe109e7609d0b50d6d54bf9e95d8
498One "triage" pass done.
499
500A second triage pass is still needed to remove unimportant changes
501
7ef88767
JV
502commit 9307c420fad2f6f5bd314f9ed66dd53288703e09
503Author: Jan Dubois <jand@activestate.com>
504Date: Thu Dec 17 18:28:16 2009 -0800
505
506 Export PL_curinterp symbol for MULTIPLICITY without USE_ITHREADS
db2ed548 507
7ef88767
JV
508 This is necessary for XS extensions that define PERL_CORE. In that
509 situation PERL_GET_CONTEXT will resolve to PL_curinterp, which is
510 normally not exported (extensions call Perl_Gcurinterp_ptr() to get a
511 pointer to PL_curinterp instead). With USE_ITHREADS defined
512 PERL_GET_CONTEXT will expand to Perl_get_context() even inside the
513 core because the context needs to be fetched from threadlocal storage.
514
515commit 8703a9a4fd75723318bc4ba1afc42a215806f2d1
7ef88767 516
db2ed548 517 Correct some #ifdef USE_ITHREADS / USE_MULTI
7ef88767 518
7ef88767
JV
519Author: Jan Dubois <jand@activestate.com>
520Date: Wed Dec 16 15:42:19 2009 -0800
521
522 -t should only return TRUE for file handles connected to a TTY
db2ed548 523
7ef88767
JV
524 The Microsoft C version of isatty() returns TRUE for all
525 character mode devices, including the /dev/null style "nul"
526 device and printers like "lpt1".
db2ed548 527
7ef88767
JV
528 The included test has only been tested on Windows and Linux;
529 the device names for OS/2 and VMS are just best guesses...
530
7ef88767
JV
531commit 0f907b96d618c97cd2e020841a70ae037954a616
532
533 [perl #70171] 5.10.0 -> 5.10.1 Regression in fafafbaf70 (Big slowdown in 5.10 @_ parameter passing)
db2ed548 534
7ef88767 535commit 2ab54efd6265713df5cd4bd0927024245675c1c2
7ef88767
JV
536
537 fix bug 67156: overload: nomethod(..., '!') return value inverted
538
539commit 412147f664b7f5805591ad996d7e5a9e70b3d80f
540
541 [perl #71204] diagnostics.pm suppresses 'Use of uninitialized value in range (or flip)' warning
db2ed548 542
7ef88767
JV
543
544commit 69dc4b30f4725ad5f212d45d3c856ac1caaacf17
545Author: Father Chrysostomos <sprout@cpan.org>
546Date: Mon Dec 14 12:19:35 2009 +0100
547
548 [perl #70764] $' fails to initialized for pre-compiled regular expression matches
db2ed548 549
7ef88767
JV
550 The match vars are associated with the regexp that last matched
551 successfully. In the case of $str =~ $qr or /$qr/, since the $qr could
552 be used in multiple scopes that need their own sets of match vars, the
553 $qr is cloned by Perl_reg_temp_copy as of change 30677/28d8d7f. This
554 happens in pp_regcomp before pp_match has stringified the LHS, hence the
555 bug. In short, /$gror/ is not equivalent to
556 ($which = !$which) ? /$gror/ : /$gror/, which is weird.
db2ed548 557
7ef88767
JV
558Author: Reini Urban <rurban@x-ray.at>
559Date: Sun Dec 13 08:06:43 2009 +0100
560
561 Eliminate OP_SETSTATE from cop.h header
db2ed548 562
7ef88767
JV
563 It had been added with change 3728 to track linenumbers in
564 optimized else, disabled by change 4309,
565 and removed with change 33072.
db2ed548 566
7ef88767
JV
567 Bump copyright, latest change was "Fix MULTICALL in List-Util" 2009-03-07
568 with commit 1bbbfc50
569
7ef88767
JV
570
571 Fix for [perl #70910] wrong line number in syntax error message
572
7ef88767
JV
573 Document config_args limitations reported in [perl #70912]
574
7ef88767
JV
575 proper error on "grep $x (1,2,3)". Solves [perl #37314]
576
7ef88767 577commit 8a27a13e89107aaf68c0748b68ee71fbd86d774b
7ef88767
JV
578
579 [perl #71076] sort with active sub (5.10 regression)
db2ed548 580
7ef88767
JV
581 One of the tests in sort.t causes a bus error (or sometimes â\80\98Undefined
582 subroutine calledâ\80\99) if run multiple times. This is because sort
583 decreases the refcount of an active sub used as a comparison routine.
db2ed548 584
7ef88767 585commit 69c3dccf5322a59cb855347c04712ba11b65328f
7ef88767
JV
586
587 Fix [perl #71078] Smart match against @_ gives false negatives
db2ed548 588
7ef88767
JV
589 @_ can contain NULLs for undefined elements
590
874e3373 591 [perl #71000] Wrong variable name in warning ; Add a new warning "Missing argument in %s"
7ef88767 592
7ef88767
JV
593
594 preserve readonly flag when saving and restoring magic flags
595
7ef88767 596commit c9930541bfa04399c3b648e83c9b750cee1154fb
7ef88767
JV
597
598 [perl #70802] -i'*' refuses to work
599
7ef88767 600commit adab996997d7ef1b54d382f5ab4304f438cd1dd0
7ef88767
JV
601
602 Cleanup all scopes before exiting a pseudo-forked process.
db2ed548 603
7ef88767
JV
604 perl_destruct() contains an assertion that the scope stack
605 is empty. The remaining scopes are due to fork() being
606 called from within a BEGIN block.
607
7ef88767 608commit 576b33a19ccaf98d4dfe201d529c55c3747f0cb6
7ef88767
JV
609
610 [rt.cpan.org #51574] Safe.pm sort {} bug accessing $a and $b with -Dusethreads
611
7ef88767 612commit ee6ba15dedda3e88eb66891eaf387c00a4c0a2fb
7ef88767
JV
613
614 Fix -DPERL_NO_UTF16_FILTER
615
7ef88767 616commit dfd167e94af611f6248e804cb228b35ca4123bd6
7ef88767
JV
617
618 Handle $@ being assigned a read-only value (without error or busting the stack).
db2ed548 619
7ef88767
JV
620 Discovered whilst investigating RT #70862.
621
622commit f5fa9033b8c1fdcbd7710850b3b0380d6b937853
7ef88767
JV
623
624 Fix RT #70862 by converting ERRSV to GvSVn() to ensure a non-NULL GvSV().
625
626commit ff868e665bf85a829dc47bfa1243b26d4367cacd
7ef88767
JV
627
628 Add error codes for getaddrinfo() and getnameinfo()
629
7ef88767 630commit 61fc5122f0d8a509834282b8ecb3252d2e4c9f5d
7ef88767
JV
631
632 Make unicode semantics the default
633
634 *****************
635
7ef88767
JV
636commit 021f53de09926928546378b3552f9240c9241dde
637Author: Gerard Goossen <gerard@ggoossen.net>
638Date: Mon Nov 16 13:58:24 2009 +0100
639
640 Force OP_REQUIRE to scalar context at the end of ck_require and don't let it become void context. Fixes problem with require not always being in scalar context.
641
642commit 6a0e50422a84b53e998825128c56791913cd03aa
643Author: Craig A. Berry <craigberry@mac.com>
644Date: Sat Nov 21 11:17:38 2009 -0600
645