This is a live mirror of the Perl 5 development currently hosted at https://github.com/perl/perl5
pod/.gitignore - remove redundant perlmacos.pod entry
[perl5.git] / pod / perltie.pod
CommitLineData
cb1a09d0 1=head1 NAME
d74e8afc 2X<tie>
cb1a09d0
AD
3
4perltie - how to hide an object class in a simple variable
5
6=head1 SYNOPSIS
7
8 tie VARIABLE, CLASSNAME, LIST
9
6fdf61fb 10 $object = tied VARIABLE
11
cb1a09d0
AD
12 untie VARIABLE
13
14=head1 DESCRIPTION
15
16Prior to release 5.0 of Perl, a programmer could use dbmopen()
5f05dabc 17to connect an on-disk database in the standard Unix dbm(3x)
18format magically to a %HASH in their program. However, their Perl was either
cb1a09d0
AD
19built with one particular dbm library or another, but not both, and
20you couldn't extend this mechanism to other packages or types of variables.
21
22Now you can.
23
24The tie() function binds a variable to a class (package) that will provide
25the implementation for access methods for that variable. Once this magic
26has been performed, accessing a tied variable automatically triggers
5a964f20 27method calls in the proper class. The complexity of the class is
cb1a09d0
AD
28hidden behind magic methods calls. The method names are in ALL CAPS,
29which is a convention that Perl uses to indicate that they're called
30implicitly rather than explicitly--just like the BEGIN() and END()
31functions.
32
33In the tie() call, C<VARIABLE> is the name of the variable to be
34enchanted. C<CLASSNAME> is the name of a class implementing objects of
35the correct type. Any additional arguments in the C<LIST> are passed to
36the appropriate constructor method for that class--meaning TIESCALAR(),
5f05dabc 37TIEARRAY(), TIEHASH(), or TIEHANDLE(). (Typically these are arguments
a7adf1f0 38such as might be passed to the dbminit() function of C.) The object
39returned by the "new" method is also returned by the tie() function,
40which would be useful if you wanted to access other methods in
41C<CLASSNAME>. (You don't actually have to return a reference to a right
5f05dabc 42"type" (e.g., HASH or C<CLASSNAME>) so long as it's a properly blessed
a7adf1f0 43object.) You can also retrieve a reference to the underlying object
44using the tied() function.
cb1a09d0
AD
45
46Unlike dbmopen(), the tie() function will not C<use> or C<require> a module
47for you--you need to do that explicitly yourself.
48
49=head2 Tying Scalars
d74e8afc 50X<scalar, tying>
cb1a09d0
AD
51
52A class implementing a tied scalar should define the following methods:
301e8125 53TIESCALAR, FETCH, STORE, and possibly UNTIE and/or DESTROY.
cb1a09d0
AD
54
55Let's look at each in turn, using as an example a tie class for
56scalars that allows the user to do something like:
57
58 tie $his_speed, 'Nice', getppid();
59 tie $my_speed, 'Nice', $$;
60
61And now whenever either of those variables is accessed, its current
62system priority is retrieved and returned. If those variables are set,
63then the process's priority is changed!
64
5aabfad6 65We'll use Jarkko Hietaniemi <F<jhi@iki.fi>>'s BSD::Resource class (not
66included) to access the PRIO_PROCESS, PRIO_MIN, and PRIO_MAX constants
67from your system, as well as the getpriority() and setpriority() system
68calls. Here's the preamble of the class.
cb1a09d0
AD
69
70 package Nice;
71 use Carp;
72 use BSD::Resource;
73 use strict;
74 $Nice::DEBUG = 0 unless defined $Nice::DEBUG;
75
13a2d996 76=over 4
cb1a09d0
AD
77
78=item TIESCALAR classname, LIST
d74e8afc 79X<TIESCALAR>
cb1a09d0
AD
80
81This is the constructor for the class. That means it is
82expected to return a blessed reference to a new scalar
83(probably anonymous) that it's creating. For example:
84
e46aa1dd
KW
85 sub TIESCALAR {
86 my $class = shift;
87 my $pid = shift || $$; # 0 means me
cb1a09d0 88
e46aa1dd
KW
89 if ($pid !~ /^\d+$/) {
90 carp "Nice::Tie::Scalar got non-numeric pid $pid" if $^W;
91 return undef;
92 }
cb1a09d0 93
e46aa1dd
KW
94 unless (kill 0, $pid) { # EPERM or ERSCH, no doubt
95 carp "Nice::Tie::Scalar got bad pid $pid: $!" if $^W;
96 return undef;
97 }
cb1a09d0 98
e46aa1dd
KW
99 return bless \$pid, $class;
100 }
cb1a09d0
AD
101
102This tie class has chosen to return an error rather than raising an
103exception if its constructor should fail. While this is how dbmopen() works,
104other classes may well not wish to be so forgiving. It checks the global
105variable C<$^W> to see whether to emit a bit of noise anyway.
106
107=item FETCH this
d74e8afc 108X<FETCH>
cb1a09d0
AD
109
110This method will be triggered every time the tied variable is accessed
111(read). It takes no arguments beyond its self reference, which is the
5f05dabc 112object representing the scalar we're dealing with. Because in this case
113we're using just a SCALAR ref for the tied scalar object, a simple $$self
cb1a09d0
AD
114allows the method to get at the real value stored there. In our example
115below, that real value is the process ID to which we've tied our variable.
116
117 sub FETCH {
118 my $self = shift;
119 confess "wrong type" unless ref $self;
120 croak "usage error" if @_;
121 my $nicety;
122 local($!) = 0;
123 $nicety = getpriority(PRIO_PROCESS, $$self);
124 if ($!) { croak "getpriority failed: $!" }
125 return $nicety;
126 }
127
128This time we've decided to blow up (raise an exception) if the renice
129fails--there's no place for us to return an error otherwise, and it's
130probably the right thing to do.
131
132=item STORE this, value
d74e8afc 133X<STORE>
cb1a09d0
AD
134
135This method will be triggered every time the tied variable is set
136(assigned). Beyond its self reference, it also expects one (and only one)
ac036724 137argument: the new value the user is trying to assign. Don't worry about
138returning a value from STORE; the semantic of assignment returning the
a177e38d 139assigned value is implemented with FETCH.
cb1a09d0 140
e46aa1dd
KW
141 sub STORE {
142 my $self = shift;
143 confess "wrong type" unless ref $self;
144 my $new_nicety = shift;
145 croak "usage error" if @_;
146
147 if ($new_nicety < PRIO_MIN) {
148 carp sprintf
149 "WARNING: priority %d less than minimum system priority %d",
150 $new_nicety, PRIO_MIN if $^W;
151 $new_nicety = PRIO_MIN;
152 }
153
154 if ($new_nicety > PRIO_MAX) {
155 carp sprintf
156 "WARNING: priority %d greater than maximum system priority %d",
157 $new_nicety, PRIO_MAX if $^W;
158 $new_nicety = PRIO_MAX;
159 }
160
161 unless (defined setpriority(PRIO_PROCESS,
162 $$self,
163 $new_nicety))
164 {
165 confess "setpriority failed: $!";
166 }
167 }
cb1a09d0 168
301e8125 169=item UNTIE this
d74e8afc 170X<UNTIE>
301e8125
NIS
171
172This method will be triggered when the C<untie> occurs. This can be useful
173if the class needs to know when no further calls will be made. (Except DESTROY
286e29d2 174of course.) See L</The C<untie> Gotcha> below for more details.
301e8125 175
cb1a09d0 176=item DESTROY this
d74e8afc 177X<DESTROY>
cb1a09d0
AD
178
179This method will be triggered when the tied variable needs to be destructed.
5f05dabc 180As with other object classes, such a method is seldom necessary, because Perl
cb1a09d0
AD
181deallocates its moribund object's memory for you automatically--this isn't
182C++, you know. We'll use a DESTROY method here for debugging purposes only.
183
184 sub DESTROY {
185 my $self = shift;
186 confess "wrong type" unless ref $self;
187 carp "[ Nice::DESTROY pid $$self ]" if $Nice::DEBUG;
188 }
189
190=back
191
192That's about all there is to it. Actually, it's more than all there
5f05dabc 193is to it, because we've done a few nice things here for the sake
cb1a09d0
AD
194of completeness, robustness, and general aesthetics. Simpler
195TIESCALAR classes are certainly possible.
196
197=head2 Tying Arrays
d74e8afc 198X<array, tying>
cb1a09d0
AD
199
200A class implementing a tied ordinary array should define the following
bf5513e0
ZA
201methods: TIEARRAY, FETCH, STORE, FETCHSIZE, STORESIZE, CLEAR
202and perhaps UNTIE and/or DESTROY.
cb1a09d0 203
a60c0954
NIS
204FETCHSIZE and STORESIZE are used to provide C<$#array> and
205equivalent C<scalar(@array)> access.
c47ff5f1 206
01020589
GS
207The methods POP, PUSH, SHIFT, UNSHIFT, SPLICE, DELETE, and EXISTS are
208required if the perl operator with the corresponding (but lowercase) name
209is to operate on the tied array. The B<Tie::Array> class can be used as a
210base class to implement the first five of these in terms of the basic
211methods above. The default implementations of DELETE and EXISTS in
212B<Tie::Array> simply C<croak>.
a60c0954 213
301e8125 214In addition EXTEND will be called when perl would have pre-extended
a60c0954
NIS
215allocation in a real array.
216
4ae85618
CT
217For this discussion, we'll implement an array whose elements are a fixed
218size at creation. If you try to create an element larger than the fixed
219size, you'll take an exception. For example:
cb1a09d0 220
4ae85618
CT
221 use FixedElem_Array;
222 tie @array, 'FixedElem_Array', 3;
223 $array[0] = 'cat'; # ok.
224 $array[1] = 'dogs'; # exception, length('dogs') > 3.
cb1a09d0
AD
225
226The preamble code for the class is as follows:
227
4ae85618 228 package FixedElem_Array;
cb1a09d0
AD
229 use Carp;
230 use strict;
231
13a2d996 232=over 4
cb1a09d0
AD
233
234=item TIEARRAY classname, LIST
d74e8afc 235X<TIEARRAY>
cb1a09d0
AD
236
237This is the constructor for the class. That means it is expected to
238return a blessed reference through which the new array (probably an
239anonymous ARRAY ref) will be accessed.
240
241In our example, just to show you that you don't I<really> have to return an
242ARRAY reference, we'll choose a HASH reference to represent our object.
4ae85618
CT
243A HASH works out well as a generic record type: the C<{ELEMSIZE}> field will
244store the maximum element size allowed, and the C<{ARRAY}> field will hold the
cb1a09d0
AD
245true ARRAY ref. If someone outside the class tries to dereference the
246object returned (doubtless thinking it an ARRAY ref), they'll blow up.
247This just goes to show you that you should respect an object's privacy.
248
249 sub TIEARRAY {
4ae85618
CT
250 my $class = shift;
251 my $elemsize = shift;
252 if ( @_ || $elemsize =~ /\D/ ) {
253 croak "usage: tie ARRAY, '" . __PACKAGE__ . "', elem_size";
254 }
255 return bless {
256 ELEMSIZE => $elemsize,
257 ARRAY => [],
258 }, $class;
cb1a09d0
AD
259 }
260
261=item FETCH this, index
d74e8afc 262X<FETCH>
cb1a09d0
AD
263
264This method will be triggered every time an individual element the tied array
265is accessed (read). It takes one argument beyond its self reference: the
266index whose value we're trying to fetch.
267
268 sub FETCH {
4ae85618
CT
269 my $self = shift;
270 my $index = shift;
271 return $self->{ARRAY}->[$index];
cb1a09d0
AD
272 }
273
301e8125 274If a negative array index is used to read from an array, the index
0b931be4 275will be translated to a positive one internally by calling FETCHSIZE
6f12eb6d
MJD
276before being passed to FETCH. You may disable this feature by
277assigning a true value to the variable C<$NEGATIVE_INDICES> in the
278tied array class.
301e8125 279
cb1a09d0
AD
280As you may have noticed, the name of the FETCH method (et al.) is the same
281for all accesses, even though the constructors differ in names (TIESCALAR
282vs TIEARRAY). While in theory you could have the same class servicing
283several tied types, in practice this becomes cumbersome, and it's easiest
5f05dabc 284to keep them at simply one tie type per class.
cb1a09d0
AD
285
286=item STORE this, index, value
d74e8afc 287X<STORE>
cb1a09d0
AD
288
289This method will be triggered every time an element in the tied array is set
290(written). It takes two arguments beyond its self reference: the index at
291which we're trying to store something and the value we're trying to put
4ae85618
CT
292there.
293
294In our example, C<undef> is really C<$self-E<gt>{ELEMSIZE}> number of
295spaces so we have a little more work to do here:
cb1a09d0 296
e46aa1dd
KW
297 sub STORE {
298 my $self = shift;
299 my( $index, $value ) = @_;
300 if ( length $value > $self->{ELEMSIZE} ) {
301 croak "length of $value is greater than $self->{ELEMSIZE}";
302 }
303 # fill in the blanks
3eb35b09 304 $self->STORESIZE( $index ) if $index > $self->FETCHSIZE();
e46aa1dd
KW
305 # right justify to keep element size for smaller elements
306 $self->{ARRAY}->[$index] = sprintf "%$self->{ELEMSIZE}s", $value;
307 }
301e8125
NIS
308
309Negative indexes are treated the same as with FETCH.
310
4ae85618 311=item FETCHSIZE this
d74e8afc 312X<FETCHSIZE>
4ae85618
CT
313
314Returns the total number of items in the tied array associated with
315object I<this>. (Equivalent to C<scalar(@array)>). For example:
316
317 sub FETCHSIZE {
318 my $self = shift;
39104754 319 return scalar $self->{ARRAY}->@*;
4ae85618
CT
320 }
321
322=item STORESIZE this, count
d74e8afc 323X<STORESIZE>
4ae85618
CT
324
325Sets the total number of items in the tied array associated with
326object I<this> to be I<count>. If this makes the array larger then
327class's mapping of C<undef> should be returned for new positions.
328If the array becomes smaller then entries beyond count should be
329deleted.
330
331In our example, 'undef' is really an element containing
332C<$self-E<gt>{ELEMSIZE}> number of spaces. Observe:
333
f9abed49
CT
334 sub STORESIZE {
335 my $self = shift;
336 my $count = shift;
337 if ( $count > $self->FETCHSIZE() ) {
338 foreach ( $count - $self->FETCHSIZE() .. $count ) {
339 $self->STORE( $_, '' );
340 }
341 } elsif ( $count < $self->FETCHSIZE() ) {
342 foreach ( 0 .. $self->FETCHSIZE() - $count - 2 ) {
343 $self->POP();
344 }
345 }
346 }
4ae85618
CT
347
348=item EXTEND this, count
d74e8afc 349X<EXTEND>
4ae85618
CT
350
351Informative call that array is likely to grow to have I<count> entries.
352Can be used to optimize allocation. This method need do nothing.
353
3eb35b09
YO
354In our example there is no reason to implement this method, so we leave
355it as a no-op. This method is only relevant to tied array implementations
356where there is the possibility of having the allocated size of the array
357be larger than is visible to a perl programmer inspecting the size of the
358array. Many tied array implementations will have no reason to implement it.
4ae85618
CT
359
360 sub EXTEND {
361 my $self = shift;
362 my $count = shift;
3eb35b09 363 # nothing to see here, move along.
4ae85618
CT
364 }
365
3eb35b09
YO
366B<NOTE:> It is generally an error to make this equivalent to STORESIZE.
367Perl may from time to time call EXTEND without wanting to actually change
368the array size directly. Any tied array should function correctly if this
369method is a no-op, even if perhaps they might not be as efficient as they
370would if this method was implemented.
371
4ae85618 372=item EXISTS this, key
d74e8afc 373X<EXISTS>
4ae85618
CT
374
375Verify that the element at index I<key> exists in the tied array I<this>.
376
377In our example, we will determine that if an element consists of
378C<$self-E<gt>{ELEMSIZE}> spaces only, it does not exist:
379
e46aa1dd
KW
380 sub EXISTS {
381 my $self = shift;
382 my $index = shift;
383 return 0 if ! defined $self->{ARRAY}->[$index] ||
384 $self->{ARRAY}->[$index] eq ' ' x $self->{ELEMSIZE};
385 return 1;
386 }
4ae85618
CT
387
388=item DELETE this, key
d74e8afc 389X<DELETE>
4ae85618
CT
390
391Delete the element at index I<key> from the tied array I<this>.
392
ad0f383a 393In our example, a deleted item is C<$self-E<gt>{ELEMSIZE}> spaces:
4ae85618
CT
394
395 sub DELETE {
396 my $self = shift;
397 my $index = shift;
398 return $self->STORE( $index, '' );
399 }
400
401=item CLEAR this
d74e8afc 402X<CLEAR>
4ae85618
CT
403
404Clear (remove, delete, ...) all values from the tied array associated with
405object I<this>. For example:
406
407 sub CLEAR {
408 my $self = shift;
409 return $self->{ARRAY} = [];
410 }
411
412=item PUSH this, LIST
d74e8afc 413X<PUSH>
4ae85618
CT
414
415Append elements of I<LIST> to the array. For example:
416
417 sub PUSH {
418 my $self = shift;
419 my @list = @_;
420 my $last = $self->FETCHSIZE();
421 $self->STORE( $last + $_, $list[$_] ) foreach 0 .. $#list;
422 return $self->FETCHSIZE();
423 }
424
425=item POP this
d74e8afc 426X<POP>
4ae85618
CT
427
428Remove last element of the array and return it. For example:
429
430 sub POP {
431 my $self = shift;
39104754 432 return pop $self->{ARRAY}->@*;
4ae85618
CT
433 }
434
435=item SHIFT this
d74e8afc 436X<SHIFT>
4ae85618
CT
437
438Remove the first element of the array (shifting other elements down)
439and return it. For example:
440
441 sub SHIFT {
442 my $self = shift;
39104754 443 return shift $self->{ARRAY}->@*;
4ae85618
CT
444 }
445
446=item UNSHIFT this, LIST
d74e8afc 447X<UNSHIFT>
4ae85618
CT
448
449Insert LIST elements at the beginning of the array, moving existing elements
450up to make room. For example:
451
452 sub UNSHIFT {
453 my $self = shift;
454 my @list = @_;
455 my $size = scalar( @list );
456 # make room for our list
39104754
RS
457 $self->{ARRAY}[ $size .. $self->{ARRAY}->$#* + $size ]->@*
458 = $self->{ARRAY}->@*
4ae85618
CT
459 $self->STORE( $_, $list[$_] ) foreach 0 .. $#list;
460 }
461
462=item SPLICE this, offset, length, LIST
d74e8afc 463X<SPLICE>
4ae85618
CT
464
465Perform the equivalent of C<splice> on the array.
466
467I<offset> is optional and defaults to zero, negative values count back
468from the end of the array.
469
470I<length> is optional and defaults to rest of the array.
471
472I<LIST> may be empty.
473
474Returns a list of the original I<length> elements at I<offset>.
475
476In our example, we'll use a little shortcut if there is a I<LIST>:
477
478 sub SPLICE {
479 my $self = shift;
480 my $offset = shift || 0;
481 my $length = shift || $self->FETCHSIZE() - $offset;
482 my @list = ();
483 if ( @_ ) {
484 tie @list, __PACKAGE__, $self->{ELEMSIZE};
485 @list = @_;
486 }
39104754 487 return splice $self->{ARRAY}->@*, $offset, $length, @list;
4ae85618
CT
488 }
489
301e8125 490=item UNTIE this
d74e8afc 491X<UNTIE>
301e8125 492
286e29d2 493Will be called when C<untie> happens. (See L</The C<untie> Gotcha> below.)
cb1a09d0
AD
494
495=item DESTROY this
d74e8afc 496X<DESTROY>
cb1a09d0
AD
497
498This method will be triggered when the tied variable needs to be destructed.
184e9718 499As with the scalar tie class, this is almost never needed in a
cb1a09d0
AD
500language that does its own garbage collection, so this time we'll
501just leave it out.
502
503=back
504
cb1a09d0 505=head2 Tying Hashes
d74e8afc 506X<hash, tying>
cb1a09d0 507
be3174d2
GS
508Hashes were the first Perl data type to be tied (see dbmopen()). A class
509implementing a tied hash should define the following methods: TIEHASH is
510the constructor. FETCH and STORE access the key and value pairs. EXISTS
511reports whether a key is present in the hash, and DELETE deletes one.
512CLEAR empties the hash by deleting all the key and value pairs. FIRSTKEY
513and NEXTKEY implement the keys() and each() functions to iterate over all
a3bcc51e 514the keys. SCALAR is triggered when the tied hash is evaluated in scalar
c9fe309b
DM
515context, and in 5.28 onwards, by C<keys> in boolean context. UNTIE is
516called when C<untie> happens, and DESTROY is called when the tied variable
517is garbage collected.
aa689395 518
519If this seems like a lot, then feel free to inherit from merely the
d5582e24 520standard Tie::StdHash module for most of your methods, redefining only the
aa689395 521interesting ones. See L<Tie::Hash> for details.
cb1a09d0
AD
522
523Remember that Perl distinguishes between a key not existing in the hash,
524and the key existing in the hash but having a corresponding value of
525C<undef>. The two possibilities can be tested with the C<exists()> and
526C<defined()> functions.
527
528Here's an example of a somewhat interesting tied hash class: it gives you
5f05dabc 529a hash representing a particular user's dot files. You index into the hash
530with the name of the file (minus the dot) and you get back that dot file's
cb1a09d0
AD
531contents. For example:
532
533 use DotFiles;
1f57c600 534 tie %dot, 'DotFiles';
cb1a09d0
AD
535 if ( $dot{profile} =~ /MANPATH/ ||
536 $dot{login} =~ /MANPATH/ ||
537 $dot{cshrc} =~ /MANPATH/ )
538 {
5f05dabc 539 print "you seem to set your MANPATH\n";
cb1a09d0
AD
540 }
541
542Or here's another sample of using our tied class:
543
1f57c600 544 tie %him, 'DotFiles', 'daemon';
cb1a09d0
AD
545 foreach $f ( keys %him ) {
546 printf "daemon dot file %s is size %d\n",
547 $f, length $him{$f};
548 }
549
550In our tied hash DotFiles example, we use a regular
551hash for the object containing several important
552fields, of which only the C<{LIST}> field will be what the
553user thinks of as the real hash.
554
555=over 5
556
557=item USER
558
559whose dot files this object represents
560
561=item HOME
562
5f05dabc 563where those dot files live
cb1a09d0
AD
564
565=item CLOBBER
566
567whether we should try to change or remove those dot files
568
569=item LIST
570
5f05dabc 571the hash of dot file names and content mappings
cb1a09d0
AD
572
573=back
574
575Here's the start of F<Dotfiles.pm>:
576
577 package DotFiles;
578 use Carp;
579 sub whowasi { (caller(1))[3] . '()' }
580 my $DEBUG = 0;
581 sub debug { $DEBUG = @_ ? shift : 1 }
582
5f05dabc 583For our example, we want to be able to emit debugging info to help in tracing
cb1a09d0
AD
584during development. We keep also one convenience function around
585internally to help print out warnings; whowasi() returns the function name
586that calls it.
587
588Here are the methods for the DotFiles tied hash.
589
13a2d996 590=over 4
cb1a09d0
AD
591
592=item TIEHASH classname, LIST
d74e8afc 593X<TIEHASH>
cb1a09d0
AD
594
595This is the constructor for the class. That means it is expected to
596return a blessed reference through which the new object (probably but not
597necessarily an anonymous hash) will be accessed.
598
599Here's the constructor:
600
601 sub TIEHASH {
ac4af195 602 my $class = shift;
cb1a09d0
AD
603 my $user = shift || $>;
604 my $dotdir = shift || '';
605 croak "usage: @{[&whowasi]} [USER [DOTDIR]]" if @_;
606 $user = getpwuid($user) if $user =~ /^\d+$/;
607 my $dir = (getpwnam($user))[7]
608 || croak "@{[&whowasi]}: no user $user";
609 $dir .= "/$dotdir" if $dotdir;
610
611 my $node = {
612 USER => $user,
613 HOME => $dir,
614 LIST => {},
615 CLOBBER => 0,
616 };
617
618 opendir(DIR, $dir)
619 || croak "@{[&whowasi]}: can't opendir $dir: $!";
620 foreach $dot ( grep /^\./ && -f "$dir/$_", readdir(DIR)) {
621 $dot =~ s/^\.//;
622 $node->{LIST}{$dot} = undef;
623 }
624 closedir DIR;
ac4af195 625 return bless $node, $class;
cb1a09d0
AD
626 }
627
628It's probably worth mentioning that if you're going to filetest the
629return values out of a readdir, you'd better prepend the directory
5f05dabc 630in question. Otherwise, because we didn't chdir() there, it would
2ae324a7 631have been testing the wrong file.
cb1a09d0
AD
632
633=item FETCH this, key
d74e8afc 634X<FETCH>
cb1a09d0
AD
635
636This method will be triggered every time an element in the tied hash is
637accessed (read). It takes one argument beyond its self reference: the key
638whose value we're trying to fetch.
639
640Here's the fetch for our DotFiles example.
641
642 sub FETCH {
643 carp &whowasi if $DEBUG;
644 my $self = shift;
645 my $dot = shift;
646 my $dir = $self->{HOME};
647 my $file = "$dir/.$dot";
648
649 unless (exists $self->{LIST}->{$dot} || -f $file) {
650 carp "@{[&whowasi]}: no $dot file" if $DEBUG;
651 return undef;
652 }
653
654 if (defined $self->{LIST}->{$dot}) {
655 return $self->{LIST}->{$dot};
656 } else {
657 return $self->{LIST}->{$dot} = `cat $dir/.$dot`;
658 }
659 }
660
661It was easy to write by having it call the Unix cat(1) command, but it
662would probably be more portable to open the file manually (and somewhat
5f05dabc 663more efficient). Of course, because dot files are a Unixy concept, we're
cb1a09d0
AD
664not that concerned.
665
666=item STORE this, key, value
d74e8afc 667X<STORE>
cb1a09d0
AD
668
669This method will be triggered every time an element in the tied hash is set
670(written). It takes two arguments beyond its self reference: the index at
671which we're trying to store something, and the value we're trying to put
672there.
673
674Here in our DotFiles example, we'll be careful not to let
675them try to overwrite the file unless they've called the clobber()
676method on the original object reference returned by tie().
677
678 sub STORE {
679 carp &whowasi if $DEBUG;
680 my $self = shift;
681 my $dot = shift;
682 my $value = shift;
683 my $file = $self->{HOME} . "/.$dot";
684 my $user = $self->{USER};
685
686 croak "@{[&whowasi]}: $file not clobberable"
687 unless $self->{CLOBBER};
688
67d00ddd
AC
689 open(my $f, '>', $file) || croak "can't open $file: $!";
690 print $f $value;
691 close($f);
cb1a09d0
AD
692 }
693
694If they wanted to clobber something, they might say:
695
696 $ob = tie %daemon_dots, 'daemon';
697 $ob->clobber(1);
698 $daemon_dots{signature} = "A true daemon\n";
699
6fdf61fb 700Another way to lay hands on a reference to the underlying object is to
701use the tied() function, so they might alternately have set clobber
702using:
703
704 tie %daemon_dots, 'daemon';
705 tied(%daemon_dots)->clobber(1);
706
707The clobber method is simply:
cb1a09d0
AD
708
709 sub clobber {
710 my $self = shift;
711 $self->{CLOBBER} = @_ ? shift : 1;
712 }
713
714=item DELETE this, key
d74e8afc 715X<DELETE>
cb1a09d0
AD
716
717This method is triggered when we remove an element from the hash,
718typically by using the delete() function. Again, we'll
719be careful to check whether they really want to clobber files.
720
e46aa1dd
KW
721 sub DELETE {
722 carp &whowasi if $DEBUG;
cb1a09d0 723
e46aa1dd
KW
724 my $self = shift;
725 my $dot = shift;
726 my $file = $self->{HOME} . "/.$dot";
727 croak "@{[&whowasi]}: won't remove file $file"
728 unless $self->{CLOBBER};
729 delete $self->{LIST}->{$dot};
730 my $success = unlink($file);
731 carp "@{[&whowasi]}: can't unlink $file: $!" unless $success;
732 $success;
733 }
cb1a09d0 734
1f57c600 735The value returned by DELETE becomes the return value of the call
736to delete(). If you want to emulate the normal behavior of delete(),
737you should return whatever FETCH would have returned for this key.
738In this example, we have chosen instead to return a value which tells
739the caller whether the file was successfully deleted.
740
cb1a09d0 741=item CLEAR this
d74e8afc 742X<CLEAR>
cb1a09d0
AD
743
744This method is triggered when the whole hash is to be cleared, usually by
745assigning the empty list to it.
746
5f05dabc 747In our example, that would remove all the user's dot files! It's such a
cb1a09d0
AD
748dangerous thing that they'll have to set CLOBBER to something higher than
7491 to make it happen.
750
e46aa1dd
KW
751 sub CLEAR {
752 carp &whowasi if $DEBUG;
753 my $self = shift;
754 croak "@{[&whowasi]}: won't remove all dot files for $self->{USER}"
755 unless $self->{CLOBBER} > 1;
756 my $dot;
39104754 757 foreach $dot ( keys $self->{LIST}->%* ) {
e46aa1dd
KW
758 $self->DELETE($dot);
759 }
760 }
cb1a09d0
AD
761
762=item EXISTS this, key
d74e8afc 763X<EXISTS>
cb1a09d0
AD
764
765This method is triggered when the user uses the exists() function
766on a particular hash. In our example, we'll look at the C<{LIST}>
767hash element for this:
768
769 sub EXISTS {
770 carp &whowasi if $DEBUG;
771 my $self = shift;
772 my $dot = shift;
773 return exists $self->{LIST}->{$dot};
774 }
775
776=item FIRSTKEY this
d74e8afc 777X<FIRSTKEY>
cb1a09d0
AD
778
779This method will be triggered when the user is going
a3faa257 780to iterate through the hash, such as via a keys(), values(), or each() call.
cb1a09d0
AD
781
782 sub FIRSTKEY {
783 carp &whowasi if $DEBUG;
784 my $self = shift;
39104754
RS
785 my $a = keys $self->{LIST}->%*; # reset each() iterator
786 each $self->{LIST}->%*
cb1a09d0
AD
787 }
788
a3faa257
JH
789FIRSTKEY is always called in scalar context and it should just
790return the first key. values(), and each() in list context,
791will call FETCH for the returned keys.
792
cb1a09d0 793=item NEXTKEY this, lastkey
d74e8afc 794X<NEXTKEY>
cb1a09d0 795
a3faa257 796This method gets triggered during a keys(), values(), or each() iteration. It has a
cb1a09d0 797second argument which is the last key that had been accessed. This is
a3faa257 798useful if you're caring about ordering or calling the iterator from more
cb1a09d0
AD
799than one sequence, or not really storing things in a hash anywhere.
800
a3faa257
JH
801NEXTKEY is always called in scalar context and it should just
802return the next key. values(), and each() in list context,
803will call FETCH for the returned keys.
804
5f05dabc 805For our example, we're using a real hash so we'll do just the simple
806thing, but we'll have to go through the LIST field indirectly.
cb1a09d0
AD
807
808 sub NEXTKEY {
809 carp &whowasi if $DEBUG;
810 my $self = shift;
39104754 811 return each $self->{LIST}->%*
cb1a09d0
AD
812 }
813
326fbc15
DC
814If the object underlying your tied hash isn't a real hash and you don't have
815C<each> available, then you should return C<undef> or the empty list once you've
816reached the end of your list of keys. See L<C<each's own documentation>|perlfunc/each>
817for more details.
818
a3bcc51e 819=item SCALAR this
d74e8afc 820X<SCALAR>
a3bcc51e 821
c9fe309b
DM
822This is called when the hash is evaluated in scalar context, and in 5.28
823onwards, by C<keys> in boolean context. In order to mimic the behaviour of
824untied hashes, this method must return a value which when used as boolean,
825indicates whether the tied hash is considered empty. If this method does
159b10bb
RGS
826not exist, perl will make some educated guesses and return true when
827the hash is inside an iteration. If this isn't the case, FIRSTKEY is
828called, and the result will be a false value if FIRSTKEY returns the empty
829list, true otherwise.
a3bcc51e 830
47b1b33c
TP
831However, you should B<not> blindly rely on perl always doing the right
832thing. Particularly, perl will mistakenly return true when you clear the
833hash by repeatedly calling DELETE until it is empty. You are therefore
834advised to supply your own SCALAR method when you want to be absolutely
835sure that your hash behaves nicely in scalar context.
836
a3bcc51e
TP
837In our example we can just call C<scalar> on the underlying hash
838referenced by C<$self-E<gt>{LIST}>:
839
840 sub SCALAR {
841 carp &whowasi if $DEBUG;
842 my $self = shift;
39104754 843 return scalar $self->{LIST}->%*
a3bcc51e
TP
844 }
845
8bf4c401
YO
846NOTE: In perl 5.25 the behavior of scalar %hash on an untied hash changed
847to return the count of keys. Prior to this it returned a string containing
848information about the bucket setup of the hash. See
849L<Hash::Util/bucket_ratio> for a backwards compatibility path.
850
301e8125 851=item UNTIE this
d74e8afc 852X<UNTIE>
301e8125 853
286e29d2 854This is called when C<untie> occurs. See L</The C<untie> Gotcha> below.
301e8125 855
cb1a09d0 856=item DESTROY this
d74e8afc 857X<DESTROY>
cb1a09d0
AD
858
859This method is triggered when a tied hash is about to go out of
860scope. You don't really need it unless you're trying to add debugging
861or have auxiliary state to clean up. Here's a very simple function:
862
863 sub DESTROY {
864 carp &whowasi if $DEBUG;
865 }
866
867=back
868
1d2dff63
GS
869Note that functions such as keys() and values() may return huge lists
870when used on large objects, like DBM files. You may prefer to use the
871each() function to iterate over such. Example:
cb1a09d0
AD
872
873 # print out history file offsets
874 use NDBM_File;
1f57c600 875 tie(%HIST, 'NDBM_File', '/usr/lib/news/history', 1, 0);
cb1a09d0
AD
876 while (($key,$val) = each %HIST) {
877 print $key, ' = ', unpack('L',$val), "\n";
878 }
879 untie(%HIST);
880
881=head2 Tying FileHandles
d74e8afc 882X<filehandle, tying>
cb1a09d0 883
184e9718 884This is partially implemented now.
a7adf1f0 885
2ae324a7 886A class implementing a tied filehandle should define the following
1d603a67 887methods: TIEHANDLE, at least one of PRINT, PRINTF, WRITE, READLINE, GETC,
301e8125 888READ, and possibly CLOSE, UNTIE and DESTROY. The class can also provide: BINMODE,
4592e6ca
NIS
889OPEN, EOF, FILENO, SEEK, TELL - if the corresponding perl operators are
890used on the handle.
a7adf1f0 891
7ff03255
SG
892When STDERR is tied, its PRINT method will be called to issue warnings
893and error messages. This feature is temporarily disabled during the call,
894which means you can use C<warn()> inside PRINT without starting a recursive
895loop. And just like C<__WARN__> and C<__DIE__> handlers, STDERR's PRINT
896method may be called to report parser errors, so the caveats mentioned under
897L<perlvar/%SIG> apply.
898
899All of this is especially useful when perl is embedded in some other
900program, where output to STDOUT and STDERR may have to be redirected
901in some special way. See nvi and the Apache module for examples.
a7adf1f0 902
a24ded60 903When tying a handle, the first argument to C<tie> should begin with an
4a904372
FC
904asterisk. So, if you are tying STDOUT, use C<*STDOUT>. If you have
905assigned it to a scalar variable, say C<$handle>, use C<*$handle>.
906C<tie $handle> ties the scalar variable C<$handle>, not the handle inside
907it.
a24ded60 908
a7adf1f0 909In our example we're going to create a shouting handle.
910
911 package Shout;
912
13a2d996 913=over 4
a7adf1f0 914
915=item TIEHANDLE classname, LIST
d74e8afc 916X<TIEHANDLE>
a7adf1f0 917
918This is the constructor for the class. That means it is expected to
184e9718 919return a blessed reference of some sort. The reference can be used to
5f05dabc 920hold some internal information.
a7adf1f0 921
7e1af8bc 922 sub TIEHANDLE { print "<shout>\n"; my $i; bless \$i, shift }
a7adf1f0 923
1d603a67 924=item WRITE this, LIST
d74e8afc 925X<WRITE>
1d603a67
GB
926
927This method will be called when the handle is written to via the
928C<syswrite> function.
929
e46aa1dd
KW
930 sub WRITE {
931 $r = shift;
932 my($buf,$len,$offset) = @_;
933 print "WRITE called, \$buf=$buf, \$len=$len, \$offset=$offset";
934 }
1d603a67 935
a7adf1f0 936=item PRINT this, LIST
d74e8afc 937X<PRINT>
a7adf1f0 938
46fc3d4c 939This method will be triggered every time the tied handle is printed to
3a28f3fb
MS
940with the C<print()> or C<say()> functions. Beyond its self reference
941it also expects the list that was passed to the print function.
a7adf1f0 942
e46aa1dd 943 sub PRINT { $r = shift; $$r++; print join($,,map(uc($_),@_)),$\ }
58f51617 944
3a28f3fb
MS
945C<say()> acts just like C<print()> except $\ will be localized to C<\n> so
946you need do nothing special to handle C<say()> in C<PRINT()>.
947
46fc3d4c 948=item PRINTF this, LIST
d74e8afc 949X<PRINTF>
46fc3d4c 950
951This method will be triggered every time the tied handle is printed to
952with the C<printf()> function.
953Beyond its self reference it also expects the format and list that was
954passed to the printf function.
955
956 sub PRINTF {
957 shift;
958 my $fmt = shift;
7687bb23 959 print sprintf($fmt, @_);
46fc3d4c 960 }
961
1d603a67 962=item READ this, LIST
d74e8afc 963X<READ>
2ae324a7 964
965This method will be called when the handle is read from via the C<read>
966or C<sysread> functions.
967
e46aa1dd
KW
968 sub READ {
969 my $self = shift;
970 my $bufref = \$_[0];
971 my(undef,$len,$offset) = @_;
972 print "READ called, \$buf=$bufref, \$len=$len, \$offset=$offset";
973 # add to $$bufref, set $len to number of characters read
974 $len;
975 }
2ae324a7 976
58f51617 977=item READLINE this
d74e8afc 978X<READLINE>
58f51617 979
2207fa4e
KR
980This method is called when the handle is read via C<E<lt>HANDLEE<gt>>
981or C<readline HANDLE>.
982
26f1b91d
FC
983As per L<C<readline>|perlfunc/readline>, in scalar context it should return
984the next line, or C<undef> for no more data. In list context it should
985return all remaining lines, or an empty list for no more data. The strings
986returned should include the input record separator C<$/> (see L<perlvar>),
987unless it is C<undef> (which means "slurp" mode).
2207fa4e
KR
988
989 sub READLINE {
990 my $r = shift;
991 if (wantarray) {
992 return ("all remaining\n",
993 "lines up\n",
994 "to eof\n");
995 } else {
26f1b91d 996 return "READLINE called " . ++$$r . " times\n";
2207fa4e
KR
997 }
998 }
a7adf1f0 999
2ae324a7 1000=item GETC this
d74e8afc 1001X<GETC>
2ae324a7 1002
1003This method will be called when the C<getc> function is called.
1004
1005 sub GETC { print "Don't GETC, Get Perl"; return "a"; }
1006
32e65323
CS
1007=item EOF this
1008X<EOF>
1009
1010This method will be called when the C<eof> function is called.
1011
1012Starting with Perl 5.12, an additional integer parameter will be passed. It
1013will be zero if C<eof> is called without parameter; C<1> if C<eof> is given
1014a filehandle as a parameter, e.g. C<eof(FH)>; and C<2> in the very special
1015case that the tied filehandle is C<ARGV> and C<eof> is called with an empty
1016parameter list, e.g. C<eof()>.
1017
1018 sub EOF { not length $stringbuf }
1019
1d603a67 1020=item CLOSE this
d74e8afc 1021X<CLOSE>
1d603a67
GB
1022
1023This method will be called when the handle is closed via the C<close>
1024function.
1025
1026 sub CLOSE { print "CLOSE called.\n" }
1027
301e8125 1028=item UNTIE this
d74e8afc 1029X<UNTIE>
301e8125
NIS
1030
1031As with the other types of ties, this method will be called when C<untie> happens.
d5582e24 1032It may be appropriate to "auto CLOSE" when this occurs. See
286e29d2 1033L</The C<untie> Gotcha> below.
301e8125 1034
a7adf1f0 1035=item DESTROY this
d74e8afc 1036X<DESTROY>
a7adf1f0 1037
1038As with the other types of ties, this method will be called when the
1039tied handle is about to be destroyed. This is useful for debugging and
1040possibly cleaning up.
1041
1042 sub DESTROY { print "</shout>\n" }
1043
1044=back
1045
1046Here's how to use our little example:
1047
1048 tie(*FOO,'Shout');
1049 print FOO "hello\n";
1050 $a = 4; $b = 6;
1051 print FOO $a, " plus ", $b, " equals ", $a + $b, "\n";
58f51617 1052 print <FOO>;
cb1a09d0 1053
d7da42b7 1054=head2 UNTIE this
d74e8afc 1055X<UNTIE>
d7da42b7
JH
1056
1057You can define for all tie types an UNTIE method that will be called
286e29d2 1058at untie(). See L</The C<untie> Gotcha> below.
d7da42b7 1059
2752eb9f 1060=head2 The C<untie> Gotcha
d74e8afc 1061X<untie>
2752eb9f
PM
1062
1063If you intend making use of the object returned from either tie() or
1064tied(), and if the tie's target class defines a destructor, there is a
1065subtle gotcha you I<must> guard against.
1066
1067As setup, consider this (admittedly rather contrived) example of a
1068tie; all it does is use a file to keep a log of the values assigned to
1069a scalar.
1070
1071 package Remember;
1072
1073 use strict;
9f1b1f2d 1074 use warnings;
2752eb9f
PM
1075 use IO::File;
1076
1077 sub TIESCALAR {
1078 my $class = shift;
1079 my $filename = shift;
63acfd00 1080 my $handle = IO::File->new( "> $filename" )
2752eb9f
PM
1081 or die "Cannot open $filename: $!\n";
1082
1083 print $handle "The Start\n";
1084 bless {FH => $handle, Value => 0}, $class;
1085 }
1086
1087 sub FETCH {
1088 my $self = shift;
1089 return $self->{Value};
1090 }
1091
1092 sub STORE {
1093 my $self = shift;
1094 my $value = shift;
1095 my $handle = $self->{FH};
1096 print $handle "$value\n";
1097 $self->{Value} = $value;
1098 }
1099
1100 sub DESTROY {
1101 my $self = shift;
1102 my $handle = $self->{FH};
1103 print $handle "The End\n";
1104 close $handle;
1105 }
1106
1107 1;
1108
1109Here is an example that makes use of this tie:
1110
1111 use strict;
1112 use Remember;
1113
1114 my $fred;
1115 tie $fred, 'Remember', 'myfile.txt';
1116 $fred = 1;
1117 $fred = 4;
1118 $fred = 5;
1119 untie $fred;
1120 system "cat myfile.txt";
1121
1122This is the output when it is executed:
1123
1124 The Start
1125 1
1126 4
1127 5
1128 The End
1129
1130So far so good. Those of you who have been paying attention will have
1131spotted that the tied object hasn't been used so far. So lets add an
1132extra method to the Remember class to allow comments to be included in
ac036724 1133the file; say, something like this:
2752eb9f
PM
1134
1135 sub comment {
1136 my $self = shift;
1137 my $text = shift;
1138 my $handle = $self->{FH};
1139 print $handle $text, "\n";
1140 }
1141
1142And here is the previous example modified to use the C<comment> method
1143(which requires the tied object):
1144
1145 use strict;
1146 use Remember;
1147
1148 my ($fred, $x);
1149 $x = tie $fred, 'Remember', 'myfile.txt';
1150 $fred = 1;
1151 $fred = 4;
1152 comment $x "changing...";
1153 $fred = 5;
1154 untie $fred;
1155 system "cat myfile.txt";
1156
1157When this code is executed there is no output. Here's why:
1158
1159When a variable is tied, it is associated with the object which is the
1160return value of the TIESCALAR, TIEARRAY, or TIEHASH function. This
1161object normally has only one reference, namely, the implicit reference
1162from the tied variable. When untie() is called, that reference is
1163destroyed. Then, as in the first example above, the object's
1164destructor (DESTROY) is called, which is normal for objects that have
1165no more valid references; and thus the file is closed.
1166
1167In the second example, however, we have stored another reference to
19799a22 1168the tied object in $x. That means that when untie() gets called
2752eb9f
PM
1169there will still be a valid reference to the object in existence, so
1170the destructor is not called at that time, and thus the file is not
1171closed. The reason there is no output is because the file buffers
1172have not been flushed to disk.
1173
1174Now that you know what the problem is, what can you do to avoid it?
301e8125
NIS
1175Prior to the introduction of the optional UNTIE method the only way
1176was the good old C<-w> flag. Which will spot any instances where you call
2752eb9f 1177untie() and there are still valid references to the tied object. If
9f1b1f2d
GS
1178the second script above this near the top C<use warnings 'untie'>
1179or was run with the C<-w> flag, Perl prints this
2752eb9f
PM
1180warning message:
1181
1182 untie attempted while 1 inner references still exist
1183
1184To get the script to work properly and silence the warning make sure
1185there are no valid references to the tied object I<before> untie() is
1186called:
1187
1188 undef $x;
1189 untie $fred;
1190
301e8125
NIS
1191Now that UNTIE exists the class designer can decide which parts of the
1192class functionality are really associated with C<untie> and which with
1193the object being destroyed. What makes sense for a given class depends
1194on whether the inner references are being kept so that non-tie-related
1195methods can be called on the object. But in most cases it probably makes
1196sense to move the functionality that would have been in DESTROY to the UNTIE
1197method.
1198
1199If the UNTIE method exists then the warning above does not occur. Instead the
1200UNTIE method is passed the count of "extra" references and can issue its own
1201warning if appropriate. e.g. to replicate the no UNTIE case this method can
1202be used:
1203
e46aa1dd
KW
1204 sub UNTIE
1205 {
1206 my ($obj,$count) = @_;
1207 carp "untie attempted while $count inner references still exist"
1208 if $count;
1209 }
301e8125 1210
cb1a09d0
AD
1211=head1 SEE ALSO
1212
1213See L<DB_File> or L<Config> for some interesting tie() implementations.
3d0ae7ba
GS
1214A good starting point for many tie() implementations is with one of the
1215modules L<Tie::Scalar>, L<Tie::Array>, L<Tie::Hash>, or L<Tie::Handle>.
cb1a09d0
AD
1216
1217=head1 BUGS
1218
8bf4c401 1219The normal return provided by C<scalar(%hash)> is not
029149a3
JH
1220available. What this means is that using %tied_hash in boolean
1221context doesn't work right (currently this always tests false,
1222regardless of whether the hash is empty or hash elements).
8bf4c401 1223[ This paragraph needs review in light of changes in 5.25 ]
029149a3
JH
1224
1225Localizing tied arrays or hashes does not work. After exiting the
1226scope the arrays or the hashes are not restored.
1227
e77edca3
JH
1228Counting the number of entries in a hash via C<scalar(keys(%hash))>
1229or C<scalar(values(%hash)>) is inefficient since it needs to iterate
1230through all the entries with FIRSTKEY/NEXTKEY.
1231
1232Tied hash/array slices cause multiple FETCH/STORE pairs, there are no
1233tie methods for slice operations.
1234
c07a80fd 1235You cannot easily tie a multilevel data structure (such as a hash of
1236hashes) to a dbm file. The first problem is that all but GDBM and
1237Berkeley DB have size limitations, but beyond that, you also have problems
bebf870e 1238with how references are to be represented on disk. One
15c110d5
DC
1239module that does attempt to address this need is DBM::Deep. Check your
1240nearest CPAN site as described in L<perlmodlib> for source code. Note
1241that despite its name, DBM::Deep does not use dbm. Another earlier attempt
1242at solving the problem is MLDBM, which is also available on the CPAN, but
1243which has some fairly serious limitations.
c07a80fd 1244
e08f2115
GA
1245Tied filehandles are still incomplete. sysopen(), truncate(),
1246flock(), fcntl(), stat() and -X can't currently be trapped.
1247
cb1a09d0
AD
1248=head1 AUTHOR
1249
1250Tom Christiansen
a7adf1f0 1251
46fc3d4c 1252TIEHANDLE by Sven Verdoolaege <F<skimo@dns.ufsia.ac.be>> and Doug MacEachern <F<dougm@osf.org>>
301e8125
NIS
1253
1254UNTIE by Nick Ing-Simmons <F<nick@ing-simmons.net>>
1255
a3bcc51e
TP
1256SCALAR by Tassilo von Parseval <F<tassilo.von.parseval@rwth-aachen.de>>
1257
e1e60e72 1258Tying Arrays by Casey West <F<casey@geeknest.com>>