This is a live mirror of the Perl 5 development currently hosted at https://github.com/perl/perl5
Tweak tests to notice $dont_use_nlink
[perl5.git] / pod / perlembed.pod
CommitLineData
a0d0e21e
LW
1=head1 NAME
2
cb1a09d0 3perlembed - how to embed perl in your C program
a0d0e21e
LW
4
5=head1 DESCRIPTION
6
cb1a09d0
AD
7=head2 PREAMBLE
8
9Do you want to:
10
11=over 5
12
96dbc785 13=item B<Use C from Perl?>
cb1a09d0
AD
14
15Read L<perlcall> and L<perlxs>.
16
96dbc785 17=item B<Use a UNIX program from Perl?>
cb1a09d0 18
5f05dabc 19Read about back-quotes and about C<system> and C<exec> in L<perlfunc>.
cb1a09d0 20
96dbc785 21=item B<Use Perl from Perl?>
cb1a09d0 22
8a7dc658
JO
23Read about L<perlfunc/do> and L<perlfunc/eval> and L<perlfunc/require>
24and L<perlfunc/use>.
cb1a09d0 25
96dbc785 26=item B<Use C from C?>
cb1a09d0
AD
27
28Rethink your design.
29
96dbc785 30=item B<Use Perl from C?>
cb1a09d0
AD
31
32Read on...
33
34=back
35
36=head2 ROADMAP
37
38L<Compiling your C program>
39
a6006777 40There's one example in each of the eight sections:
cb1a09d0
AD
41
42L<Adding a Perl interpreter to your C program>
43
44L<Calling a Perl subroutine from your C program>
45
46L<Evaluating a Perl statement from your C program>
47
48L<Performing Perl pattern matches and substitutions from your C program>
49
50L<Fiddling with the Perl stack from your C program>
51
a6006777 52L<Maintaining a persistent interpreter>
53
8ebc5c01 54L<Maintaining multiple interpreter instances>
55
96dbc785 56L<Using Perl modules, which themselves use C libraries, from your C program>
57
8a7dc658
JO
58This documentation is Unix specific; if you have information about how
59to embed Perl on other platforms, please send e-mail to
60orwant@tpj.com.
cb1a09d0
AD
61
62=head2 Compiling your C program
63
8a7dc658
JO
64If you have trouble compiling the scripts in this documentation,
65you're not alone. The cardinal rule: COMPILE THE PROGRAMS IN EXACTLY
66THE SAME WAY THAT YOUR PERL WAS COMPILED. (Sorry for yelling.)
cb1a09d0 67
8a7dc658 68Also, every C program that uses Perl must link in the I<perl library>.
cb1a09d0
AD
69What's that, you ask? Perl is itself written in C; the perl library
70is the collection of compiled C programs that were used to create your
71perl executable (I</usr/bin/perl> or equivalent). (Corollary: you
72can't use Perl from your C program unless Perl has been compiled on
73your machine, or installed properly--that's why you shouldn't blithely
74copy Perl executables from machine to machine without also copying the
75I<lib> directory.)
76
8a7dc658
JO
77When you use Perl from C, your C program will--usually--allocate,
78"run", and deallocate a I<PerlInterpreter> object, which is defined by
79the perl library.
cb1a09d0
AD
80
81If your copy of Perl is recent enough to contain this documentation
a6006777 82(version 5.002 or later), then the perl library (and I<EXTERN.h> and
8a7dc658
JO
83I<perl.h>, which you'll also need) will reside in a directory
84that looks like this:
cb1a09d0
AD
85
86 /usr/local/lib/perl5/your_architecture_here/CORE
87
88or perhaps just
89
90 /usr/local/lib/perl5/CORE
91
92or maybe something like
93
94 /usr/opt/perl5/CORE
95
96Execute this statement for a hint about where to find CORE:
97
96dbc785 98 perl -MConfig -e 'print $Config{archlib}'
cb1a09d0 99
8a7dc658
JO
100Here's how you'd compile the example in the next section,
101L<Adding a Perl interpreter to your C program>, on my Linux box:
cb1a09d0 102
8a7dc658
JO
103 % gcc -O2 -Dbool=char -DHAS_BOOL -I/usr/local/include
104 -I/usr/local/lib/perl5/i586-linux/5.003/CORE
105 -L/usr/local/lib/perl5/i586-linux/5.003/CORE
106 -o interp interp.c -lperl -lm
cb1a09d0 107
8a7dc658
JO
108(That's all one line.) On my DEC Alpha running 5.00305, the incantation
109is a bit different:
110
111 % cc -O2 -Olimit 2900 -DSTANDARD_C -I/usr/local/include
112 -I/usr/local/lib/perl5/alpha-dec_osf/5.00305/CORE
113 -L/usr/local/lib/perl5/alpha-dec_osf/5.00305/CORE -L/usr/local/lib
114 -D__LANGUAGE_C__ -D_NO_PROTO -o interp interp.c -lperl -lm
115
116How can you figure out what to add? Assuming your Perl is post-5.001,
117execute a C<perl -V> command and pay special attention to the "cc" and
118"ccflags" information.
119
120You'll have to choose the appropriate compiler (I<cc>, I<gcc>, et al.) for
121your machine: C<perl -MConfig -e 'print $Config{cc}'> will tell you what
122to use.
123
124You'll also have to choose the appropriate library directory
125(I</usr/local/lib/...>) for your machine. If your compiler complains
126that certain functions are undefined, or that it can't locate
127I<-lperl>, then you need to change the path following the C<-L>. If it
128complains that it can't find I<EXTERN.h> and I<perl.h>, you need to
129change the path following the C<-I>.
cb1a09d0
AD
130
131You may have to add extra libraries as well. Which ones?
96dbc785 132Perhaps those printed by
133
134 perl -MConfig -e 'print $Config{libs}'
135
8a7dc658
JO
136Provided your perl binary was properly configured and installed the
137B<ExtUtils::Embed> module will determine all of this information for
138you:
96dbc785 139
140 % cc -o interp interp.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
141
8a7dc658
JO
142If the B<ExtUtils::Embed> module isn't part of your Perl distribution,
143you can retrieve it from
144http://www.perl.com/perl/CPAN/modules/by-module/ExtUtils::Embed. (If
145this documentation came from your Perl distribution, then you're
146running 5.004 or better and you already have it.)
96dbc785 147
8a7dc658
JO
148The B<ExtUtils::Embed> kit on CPAN also contains all source code for
149the examples in this document, tests, additional examples and other
150information you may find useful.
cb1a09d0
AD
151
152=head2 Adding a Perl interpreter to your C program
153
154In a sense, perl (the C program) is a good example of embedding Perl
155(the language), so I'll demonstrate embedding with I<miniperlmain.c>,
8a7dc658
JO
156from the source distribution. Here's a bastardized, non-portable
157version of I<miniperlmain.c> containing the essentials of embedding:
cb1a09d0 158
cb1a09d0
AD
159 #include <EXTERN.h> /* from the Perl distribution */
160 #include <perl.h> /* from the Perl distribution */
96dbc785 161
cb1a09d0 162 static PerlInterpreter *my_perl; /*** The Perl interpreter ***/
96dbc785 163
c07a80fd 164 int main(int argc, char **argv, char **env)
cb1a09d0
AD
165 {
166 my_perl = perl_alloc();
167 perl_construct(my_perl);
96dbc785 168 perl_parse(my_perl, NULL, argc, argv, (char **)NULL);
cb1a09d0
AD
169 perl_run(my_perl);
170 perl_destruct(my_perl);
171 perl_free(my_perl);
172 }
173
8a7dc658
JO
174Notice that we don't use the C<env> pointer. Normally handed to
175C<perl_parse> as its final argument, C<env> here is replaced by
176C<NULL>, which means that the current environment will be used.
96dbc785 177
cb1a09d0
AD
178Now compile this program (I'll call it I<interp.c>) into an executable:
179
96dbc785 180 % cc -o interp interp.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
cb1a09d0
AD
181
182After a successful compilation, you'll be able to use I<interp> just
183like perl itself:
184
185 % interp
186 print "Pretty Good Perl \n";
187 print "10890 - 9801 is ", 10890 - 9801;
188 <CTRL-D>
189 Pretty Good Perl
190 10890 - 9801 is 1089
191
192or
193
194 % interp -e 'printf("%x", 3735928559)'
195 deadbeef
196
197You can also read and execute Perl statements from a file while in the
198midst of your C program, by placing the filename in I<argv[1]> before
96dbc785 199calling I<perl_run()>.
cb1a09d0
AD
200
201=head2 Calling a Perl subroutine from your C program
202
8ebc5c01 203To call individual Perl subroutines, you can use any of the B<perl_call_*>
204functions documented in the L<perlcall> man page.
205In this example we'll use I<perl_call_argv>.
cb1a09d0
AD
206
207That's shown below, in a program I'll call I<showtime.c>.
208
cb1a09d0 209 #include <EXTERN.h>
96dbc785 210 #include <perl.h>
211
212 static PerlInterpreter *my_perl;
213
c07a80fd 214 int main(int argc, char **argv, char **env)
cb1a09d0 215 {
8ebc5c01 216 char *args[] = { NULL };
cb1a09d0
AD
217 my_perl = perl_alloc();
218 perl_construct(my_perl);
96dbc785 219
220 perl_parse(my_perl, NULL, argc, argv, NULL);
221
8ebc5c01 222 /*** skipping perl_run() ***/
223
224 perl_call_argv("showtime", G_DISCARD | G_NOARGS, args);
225
cb1a09d0
AD
226 perl_destruct(my_perl);
227 perl_free(my_perl);
228 }
229
230where I<showtime> is a Perl subroutine that takes no arguments (that's the
96dbc785 231I<G_NOARGS>) and for which I'll ignore the return value (that's the
cb1a09d0
AD
232I<G_DISCARD>). Those flags, and others, are discussed in L<perlcall>.
233
234I'll define the I<showtime> subroutine in a file called I<showtime.pl>:
235
236 print "I shan't be printed.";
96dbc785 237
cb1a09d0
AD
238 sub showtime {
239 print time;
240 }
241
242Simple enough. Now compile and run:
243
96dbc785 244 % cc -o showtime showtime.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
245
cb1a09d0
AD
246 % showtime showtime.pl
247 818284590
248
249yielding the number of seconds that elapsed between January 1, 1970
8a7dc658 250(the beginning of the Unix epoch), and the moment I began writing this
cb1a09d0
AD
251sentence.
252
8a7dc658
JO
253In this particular case we don't have to call I<perl_run>, but in
254general it's considered good practice to ensure proper initialization
255of library code, including execution of all object C<DESTROY> methods
256and package C<END {}> blocks.
8ebc5c01 257
8a7dc658
JO
258If you want to pass arguments to the Perl subroutine, you can add
259strings to the C<NULL>-terminated C<args> list passed to
260I<perl_call_argv>. For other data types, or to examine return values,
261you'll need to manipulate the Perl stack. That's demonstrated in the
262last section of this document: L<Fiddling with the Perl stack from
263your C program>.
cb1a09d0
AD
264
265=head2 Evaluating a Perl statement from your C program
266
8a7dc658
JO
267One way to evaluate pieces of Perl code is to use
268L<perlguts/perl_eval_sv()>. We've wrapped this inside our own
269I<perl_eval()> function, which converts a command string to an SV,
270passing this and the L<perlcall/G_DISCARD> flag to
271L<perlguts/perl_eval_sv()>.
cb1a09d0
AD
272
273Arguably, this is the only routine you'll ever need to execute
274snippets of Perl code from within your C program. Your string can be
8a7dc658
JO
275as long as you wish; it can contain multiple statements; it can employ
276L<perlfunc/use>, L<perlfunc/require> and L<perlfunc/do> to include
277external Perl files.
cb1a09d0 278
96dbc785 279Our I<perl_eval()> lets us evaluate individual Perl strings, and then
280extract variables for coercion into C types. The following program,
cb1a09d0
AD
281I<string.c>, executes three Perl strings, extracting an C<int> from
282the first, a C<float> from the second, and a C<char *> from the third.
283
cb1a09d0
AD
284 #include <EXTERN.h>
285 #include <perl.h>
96dbc785 286
cb1a09d0 287 static PerlInterpreter *my_perl;
96dbc785 288
a6006777 289 I32 perl_eval(char *string)
cb1a09d0 290 {
a6006777 291 return perl_eval_sv(newSVpv(string,0), G_DISCARD);
cb1a09d0 292 }
96dbc785 293
c07a80fd 294 main (int argc, char **argv, char **env)
cb1a09d0 295 {
a6006777 296 char *embedding[] = { "", "-e", "0" };
cb1a09d0 297 STRLEN length;
96dbc785 298
cb1a09d0
AD
299 my_perl = perl_alloc();
300 perl_construct( my_perl );
96dbc785 301
302 perl_parse(my_perl, NULL, 3, embedding, NULL);
8ebc5c01 303 perl_run(my_perl);
cb1a09d0
AD
304 /** Treat $a as an integer **/
305 perl_eval("$a = 3; $a **= 2");
306 printf("a = %d\n", SvIV(perl_get_sv("a", FALSE)));
96dbc785 307
cb1a09d0
AD
308 /** Treat $a as a float **/
309 perl_eval("$a = 3.14; $a **= 2");
310 printf("a = %f\n", SvNV(perl_get_sv("a", FALSE)));
96dbc785 311
cb1a09d0
AD
312 /** Treat $a as a string **/
313 perl_eval("$a = 'rekcaH lreP rehtonA tsuJ'; $a = reverse($a); ");
314 printf("a = %s\n", SvPV(perl_get_sv("a", FALSE), length));
96dbc785 315
cb1a09d0
AD
316 perl_destruct(my_perl);
317 perl_free(my_perl);
318 }
319
320All of those strange functions with I<sv> in their names help convert Perl scalars to C types. They're described in L<perlguts>.
321
322If you compile and run I<string.c>, you'll see the results of using
323I<SvIV()> to create an C<int>, I<SvNV()> to create a C<float>, and
324I<SvPV()> to create a string:
325
326 a = 9
327 a = 9.859600
328 a = Just Another Perl Hacker
329
330
331=head2 Performing Perl pattern matches and substitutions from your C program
332
333Our I<perl_eval()> lets us evaluate strings of Perl code, so we can
334define some functions that use it to "specialize" in matches and
335substitutions: I<match()>, I<substitute()>, and I<matches()>.
336
96dbc785 337 char match(char *string, char *pattern);
cb1a09d0 338
8a7dc658
JO
339Given a string and a pattern (e.g., C<m/clasp/> or C</\b\w*\b/>, which
340in your C program might appear as "/\\b\\w*\\b/"), match()
cb1a09d0
AD
341returns 1 if the string matches the pattern and 0 otherwise.
342
cb1a09d0
AD
343 int substitute(char *string[], char *pattern);
344
8a7dc658
JO
345Given a pointer to a string and an C<=~> operation (e.g.,
346C<s/bob/robert/g> or C<tr[A-Z][a-z]>), substitute() modifies the string
347according to the operation, returning the number of substitutions
348made.
cb1a09d0
AD
349
350 int matches(char *string, char *pattern, char **matches[]);
351
352Given a string, a pattern, and a pointer to an empty array of strings,
8a7dc658
JO
353matches() evaluates C<$string =~ $pattern> in an array context, and
354fills in I<matches> with the array elements (allocating memory as it
355does so), returning the number of matches found.
cb1a09d0 356
96dbc785 357Here's a sample program, I<match.c>, that uses all three (long lines have
358been wrapped here):
cb1a09d0 359
cb1a09d0
AD
360 #include <EXTERN.h>
361 #include <perl.h>
8a7dc658 362
cb1a09d0 363 static PerlInterpreter *my_perl;
a6006777 364 I32 perl_eval(char *string)
cb1a09d0 365 {
a6006777 366 return perl_eval_sv(newSVpv(string,0), G_DISCARD);
cb1a09d0 367 }
cb1a09d0 368 /** match(string, pattern)
96dbc785 369 **
370 ** Used for matches in a scalar context.
371 **
372 ** Returns 1 if the match was successful; 0 otherwise.
373 **/
374 char match(char *string, char *pattern)
cb1a09d0
AD
375 {
376 char *command;
377 command = malloc(sizeof(char) * strlen(string) + strlen(pattern) + 37);
96dbc785 378 sprintf(command, "$string = '%s'; $return = $string =~ %s",
8ebc5c01 379 string, pattern);
cb1a09d0
AD
380 perl_eval(command);
381 free(command);
382 return SvIV(perl_get_sv("return", FALSE));
383 }
cb1a09d0 384 /** substitute(string, pattern)
96dbc785 385 **
386 ** Used for =~ operations that modify their left-hand side (s/// and tr///)
387 **
388 ** Returns the number of successful matches, and
389 ** modifies the input string if there were any.
390 **/
391 int substitute(char *string[], char *pattern)
cb1a09d0
AD
392 {
393 char *command;
394 STRLEN length;
395 command = malloc(sizeof(char) * strlen(*string) + strlen(pattern) + 35);
96dbc785 396 sprintf(command, "$string = '%s'; $ret = ($string =~ %s)",
8ebc5c01 397 *string, pattern);
398 perl_eval(command);
399 free(command);
400 *string = SvPV(perl_get_sv("string", FALSE), length);
401 return SvIV(perl_get_sv("ret", FALSE));
cb1a09d0 402 }
cb1a09d0 403 /** matches(string, pattern, matches)
96dbc785 404 **
405 ** Used for matches in an array context.
406 **
407 ** Returns the number of matches,
408 ** and fills in **matches with the matching substrings (allocates memory!)
409 **/
410 int matches(char *string, char *pattern, char **match_list[])
cb1a09d0
AD
411 {
412 char *command;
413 SV *current_match;
414 AV *array;
415 I32 num_matches;
416 STRLEN length;
417 int i;
cb1a09d0 418 command = malloc(sizeof(char) * strlen(string) + strlen(pattern) + 38);
96dbc785 419 sprintf(command, "$string = '%s'; @array = ($string =~ %s)",
8ebc5c01 420 string, pattern);
cb1a09d0
AD
421 perl_eval(command);
422 free(command);
423 array = perl_get_av("array", FALSE);
424 num_matches = av_len(array) + 1; /** assume $[ is 0 **/
96dbc785 425 *match_list = (char **) malloc(sizeof(char *) * num_matches);
426 for (i = 0; i <= num_matches; i++) {
cb1a09d0 427 current_match = av_shift(array);
96dbc785 428 (*match_list)[i] = SvPV(current_match, length);
cb1a09d0
AD
429 }
430 return num_matches;
431 }
c07a80fd 432 main (int argc, char **argv, char **env)
cb1a09d0 433 {
a6006777 434 char *embedding[] = { "", "-e", "0" };
96dbc785 435 char *text, **match_list;
cb1a09d0
AD
436 int num_matches, i;
437 int j;
cb1a09d0
AD
438 my_perl = perl_alloc();
439 perl_construct( my_perl );
96dbc785 440 perl_parse(my_perl, NULL, 3, embedding, NULL);
8ebc5c01 441 perl_run(my_perl);
442
cb1a09d0 443 text = (char *) malloc(sizeof(char) * 486); /** A long string follows! **/
96dbc785 444 sprintf(text, "%s", "When he is at a convenience store and the bill \
445 comes to some amount like 76 cents, Maynard is aware that there is \
446 something he *should* do, something that will enable him to get back \
447 a quarter, but he has no idea *what*. He fumbles through his red \
448 squeezey changepurse and gives the boy three extra pennies with his \
449 dollar, hoping that he might luck into the correct amount. The boy \
450 gives him back two of his own pennies and then the big shiny quarter \
451 that is his prize. -RICHH");
452 if (match(text, "m/quarter/")) /** Does text contain 'quarter'? **/
453 printf("match: Text contains the word 'quarter'.\n\n");
454 else
455 printf("match: Text doesn't contain the word 'quarter'.\n\n");
456 if (match(text, "m/eighth/")) /** Does text contain 'eighth'? **/
457 printf("match: Text contains the word 'eighth'.\n\n");
458 else
459 printf("match: Text doesn't contain the word 'eighth'.\n\n");
460 /** Match all occurrences of /wi../ **/
461 num_matches = matches(text, "m/(wi..)/g", &match_list);
462 printf("matches: m/(wi..)/g found %d matches...\n", num_matches);
463 for (i = 0; i < num_matches; i++)
464 printf("match: %s\n", match_list[i]);
cb1a09d0
AD
465 printf("\n");
466 for (i = 0; i < num_matches; i++) {
96dbc785 467 free(match_list[i]);
cb1a09d0 468 }
96dbc785 469 free(match_list);
470 /** Remove all vowels from text **/
471 num_matches = substitute(&text, "s/[aeiou]//gi");
cb1a09d0 472 if (num_matches) {
96dbc785 473 printf("substitute: s/[aeiou]//gi...%d substitutions made.\n",
8ebc5c01 474 num_matches);
cb1a09d0
AD
475 printf("Now text is: %s\n\n", text);
476 }
96dbc785 477 /** Attempt a substitution **/
478 if (!substitute(&text, "s/Perl/C/")) {
479 printf("substitute: s/Perl/C...No substitution made.\n\n");
cb1a09d0 480 }
cb1a09d0 481 free(text);
cb1a09d0
AD
482 perl_destruct(my_perl);
483 perl_free(my_perl);
484 }
485
96dbc785 486which produces the output (again, long lines have been wrapped here)
cb1a09d0 487
8a7dc658 488 match: Text contains the word 'quarter'.
96dbc785 489
8a7dc658 490 match: Text doesn't contain the word 'eighth'.
96dbc785 491
8a7dc658 492 matches: m/(wi..)/g found 2 matches...
cb1a09d0
AD
493 match: will
494 match: with
96dbc785 495
8a7dc658 496 substitute: s/[aeiou]//gi...139 substitutions made.
96dbc785 497 Now text is: Whn h s t cnvnnc str nd th bll cms t sm mnt lk 76 cnts,
498 Mynrd s wr tht thr s smthng h *shld* d, smthng tht wll nbl hm t gt bck
499 qrtr, bt h hs n d *wht*. H fmbls thrgh hs rd sqzy chngprs nd gvs th by
500 thr xtr pnns wth hs dllr, hpng tht h mght lck nt th crrct mnt. Th by gvs
501 hm bck tw f hs wn pnns nd thn th bg shny qrtr tht s hs prz. -RCHH
502
8a7dc658 503 substitute: s/Perl/C...No substitution made.
96dbc785 504
cb1a09d0
AD
505=head2 Fiddling with the Perl stack from your C program
506
507When trying to explain stacks, most computer science textbooks mumble
508something about spring-loaded columns of cafeteria plates: the last
509thing you pushed on the stack is the first thing you pop off. That'll
510do for our purposes: your C program will push some arguments onto "the Perl
511stack", shut its eyes while some magic happens, and then pop the
512results--the return value of your Perl subroutine--off the stack.
96dbc785 513
cb1a09d0
AD
514First you'll need to know how to convert between C types and Perl
515types, with newSViv() and sv_setnv() and newAV() and all their
516friends. They're described in L<perlguts>.
517
518Then you'll need to know how to manipulate the Perl stack. That's
519described in L<perlcall>.
520
96dbc785 521Once you've understood those, embedding Perl in C is easy.
cb1a09d0 522
5f05dabc 523Because C has no built-in function for integer exponentiation, let's
cb1a09d0 524make Perl's ** operator available to it (this is less useful than it
5f05dabc 525sounds, because Perl implements ** with C's I<pow()> function). First
cb1a09d0
AD
526I'll create a stub exponentiation function in I<power.pl>:
527
528 sub expo {
529 my ($a, $b) = @_;
530 return $a ** $b;
531 }
532
533Now I'll create a C program, I<power.c>, with a function
534I<PerlPower()> that contains all the perlguts necessary to push the
535two arguments into I<expo()> and to pop the return value out. Take a
536deep breath...
537
cb1a09d0
AD
538 #include <EXTERN.h>
539 #include <perl.h>
96dbc785 540
cb1a09d0 541 static PerlInterpreter *my_perl;
96dbc785 542
cb1a09d0
AD
543 static void
544 PerlPower(int a, int b)
545 {
546 dSP; /* initialize stack pointer */
547 ENTER; /* everything created after here */
548 SAVETMPS; /* ...is a temporary variable. */
549 PUSHMARK(sp); /* remember the stack pointer */
550 XPUSHs(sv_2mortal(newSViv(a))); /* push the base onto the stack */
551 XPUSHs(sv_2mortal(newSViv(b))); /* push the exponent onto stack */
552 PUTBACK; /* make local stack pointer global */
553 perl_call_pv("expo", G_SCALAR); /* call the function */
554 SPAGAIN; /* refresh stack pointer */
555 /* pop the return value from stack */
556 printf ("%d to the %dth power is %d.\n", a, b, POPi);
96dbc785 557 PUTBACK;
cb1a09d0
AD
558 FREETMPS; /* free that return value */
559 LEAVE; /* ...and the XPUSHed "mortal" args.*/
560 }
96dbc785 561
562 int main (int argc, char **argv, char **env)
cb1a09d0
AD
563 {
564 char *my_argv[2];
96dbc785 565
cb1a09d0
AD
566 my_perl = perl_alloc();
567 perl_construct( my_perl );
96dbc785 568
cb1a09d0
AD
569 my_argv[1] = (char *) malloc(10);
570 sprintf(my_argv[1], "power.pl");
96dbc785 571
572 perl_parse(my_perl, NULL, argc, my_argv, NULL);
8ebc5c01 573 perl_run(my_perl);
96dbc785 574
cb1a09d0 575 PerlPower(3, 4); /*** Compute 3 ** 4 ***/
96dbc785 576
cb1a09d0
AD
577 perl_destruct(my_perl);
578 perl_free(my_perl);
579 }
96dbc785 580
cb1a09d0
AD
581
582
583Compile and run:
584
96dbc785 585 % cc -o power power.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
586
587 % power
cb1a09d0
AD
588 3 to the 4th power is 81.
589
a6006777 590=head2 Maintaining a persistent interpreter
591
8a7dc658
JO
592When developing interactive and/or potentially long-running
593applications, it's a good idea to maintain a persistent interpreter
594rather than allocating and constructing a new interpreter multiple
595times. The major reason is speed: since Perl will only be loaded into
596memory once.
597
598However, you have to be more cautious with namespace and variable
599scoping when using a persistent interpreter. In previous examples
600we've been using global variables in the default package C<main>. We
601knew exactly what code would be run, and assumed we could avoid
602variable collisions and outrageous symbol table growth.
603
604Let's say your application is a server that will occasionally run Perl
605code from some arbitrary file. Your server has no way of knowing what
606code it's going to run. Very dangerous.
607
608If the file is pulled in by C<perl_parse()>, compiled into a newly
609constructed interpreter, and subsequently cleaned out with
610C<perl_destruct()> afterwards, you're shielded from most namespace
611troubles.
612
613One way to avoid namespace collisions in this scenario is to translate
614the filename into a guaranteed-unique package name, and then compile
615the code into that package using L<perlfunc/eval>. In the example
616below, each file will only be compiled once. Or, the application
617might choose to clean out the symbol table associated with the file
618after it's no longer needed. Using L<perlcall/perl_call_argv>, We'll
619call the subroutine C<Embed::Persistent::eval_file> which lives in the
620file C<persistent.pl> and pass the filename and boolean cleanup/cache
a6006777 621flag as arguments.
622
8a7dc658
JO
623Note that the process will continue to grow for each file that it
624uses. In addition, there might be C<AUTOLOAD>ed subroutines and other
625conditions that cause Perl's symbol table to grow. You might want to
626add some logic that keeps track of the process size, or restarts
627itself after a certain number of requests, to ensure that memory
628consumption is minimized. You'll also want to scope your variables
629with L<perlfunc/my> whenever possible.
a6006777 630
631
632 package Embed::Persistent;
633 #persistent.pl
634
635 use strict;
636 use vars '%Cache';
637
a6006777 638 sub valid_package_name {
639 my($string) = @_;
640 $string =~ s/([^A-Za-z0-9\/])/sprintf("_%2x",unpack("C",$1))/eg;
641 # second pass only for words starting with a digit
642 $string =~ s|/(\d)|sprintf("/_%2x",unpack("C",$1))|eg;
643
644 # Dress it up as a real package name
645 $string =~ s|/|::|g;
646 return "Embed" . $string;
647 }
648
649 #borrowed from Safe.pm
650 sub delete_package {
651 my $pkg = shift;
652 my ($stem, $leaf);
653
654 no strict 'refs';
8ebc5c01 655 $pkg = "main::$pkg\::"; # expand to full symbol table name
a6006777 656 ($stem, $leaf) = $pkg =~ m/(.*::)(\w+::)$/;
657
658 my $stem_symtab = *{$stem}{HASH};
659
660 delete $stem_symtab->{$leaf};
661 }
662
663 sub eval_file {
664 my($filename, $delete) = @_;
665 my $package = valid_package_name($filename);
666 my $mtime = -M $filename;
667 if(defined $Cache{$package}{mtime}
668 &&
669 $Cache{$package}{mtime} <= $mtime)
670 {
8ebc5c01 671 # we have compiled this subroutine already,
672 # it has not been updated on disk, nothing left to do
673 print STDERR "already compiled $package->handler\n";
a6006777 674 }
675 else {
8ebc5c01 676 local *FH;
677 open FH, $filename or die "open '$filename' $!";
678 local($/) = undef;
679 my $sub = <FH>;
680 close FH;
a6006777 681
8ebc5c01 682 #wrap the code into a subroutine inside our unique package
683 my $eval = qq{package $package; sub handler { $sub; }};
684 {
685 # hide our variables within this block
686 my($filename,$mtime,$package,$sub);
687 eval $eval;
688 }
689 die $@ if $@;
a6006777 690
8ebc5c01 691 #cache it unless we're cleaning out each time
692 $Cache{$package}{mtime} = $mtime unless $delete;
a6006777 693 }
694
695 eval {$package->handler;};
696 die $@ if $@;
697
698 delete_package($package) if $delete;
699
700 #take a look if you want
701 #print Devel::Symdump->rnew($package)->as_string, $/;
702 }
703
704 1;
705
706 __END__
707
708 /* persistent.c */
709 #include <EXTERN.h>
710 #include <perl.h>
711
712 /* 1 = clean out filename's symbol table after each request, 0 = don't */
713 #ifndef DO_CLEAN
714 #define DO_CLEAN 0
715 #endif
716
717 static PerlInterpreter *perl = NULL;
718
719 int
720 main(int argc, char **argv, char **env)
721 {
722 char *embedding[] = { "", "persistent.pl" };
723 char *args[] = { "", DO_CLEAN, NULL };
724 char filename [1024];
725 int exitstatus = 0;
726
727 if((perl = perl_alloc()) == NULL) {
8ebc5c01 728 fprintf(stderr, "no memory!");
729 exit(1);
a6006777 730 }
731 perl_construct(perl);
732
733 exitstatus = perl_parse(perl, NULL, 2, embedding, NULL);
734
735 if(!exitstatus) {
8ebc5c01 736 exitstatus = perl_run(perl);
a6006777 737
8ebc5c01 738 while(printf("Enter file name: ") && gets(filename)) {
a6006777 739
8ebc5c01 740 /* call the subroutine, passing it the filename as an argument */
741 args[0] = filename;
742 perl_call_argv("Embed::Persistent::eval_file",
743 G_DISCARD | G_EVAL, args);
a6006777 744
8ebc5c01 745 /* check $@ */
746 if(SvTRUE(GvSV(errgv)))
747 fprintf(stderr, "eval error: %s\n", SvPV(GvSV(errgv),na));
748 }
a6006777 749 }
750
751 perl_destruct_level = 0;
752 perl_destruct(perl);
753 perl_free(perl);
754 exit(exitstatus);
755 }
756
757
758Now compile:
759
8a7dc658 760 % cc -o persistent persistent.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
a6006777 761
762Here's a example script file:
763
764 #test.pl
765 my $string = "hello";
766 foo($string);
767
768 sub foo {
769 print "foo says: @_\n";
770 }
771
772Now run:
773
774 % persistent
775 Enter file name: test.pl
776 foo says: hello
777 Enter file name: test.pl
778 already compiled Embed::test_2epl->handler
779 foo says: hello
780 Enter file name: ^C
781
8ebc5c01 782=head2 Maintaining multiple interpreter instances
783
8a7dc658
JO
784Some rare applications will need to create more than one interpreter
785during a session. Such an application might sporadically decide to
786release any resources associated with the interpreter.
787
788The program must take care to ensure that this takes place I<before>
789the next interpreter is constructed. By default, the global variable
790C<perl_destruct_level> is set to C<0>, since extra cleaning isn't
791needed when a program has only one interpreter.
792
793Setting C<perl_destruct_level> to C<1> makes everything squeaky clean:
794
795 perl_destruct_level = 1;
8ebc5c01 796
8ebc5c01 797 while(1) {
798 ...
799 /* reset global variables here with perl_destruct_level = 1 */
8a7dc658 800 perl_construct(my_perl);
8ebc5c01 801 ...
802 /* clean and reset _everything_ during perl_destruct */
8a7dc658 803 perl_destruct(my_perl);
8ebc5c01 804 perl_free(my_perl);
805 ...
806 /* let's go do it again! */
807 }
808
8a7dc658
JO
809When I<perl_destruct()> is called, the interpreter's syntax parse tree
810and symbol tables are cleaned up, and global variables are reset.
8ebc5c01 811
8a7dc658
JO
812Now suppose we have more than one interpreter instance running at the
813same time. This is feasible, but only if you used the
814C<-DMULTIPLICITY> flag when building Perl. By default, that sets
815C<perl_destruct_level> to C<1>.
8ebc5c01 816
817Let's give it a try:
818
819
820 #include <EXTERN.h>
8a7dc658 821 #include <perl.h>
8ebc5c01 822
823 /* we're going to embed two interpreters */
824 /* we're going to embed two interpreters */
825
8ebc5c01 826 #define SAY_HELLO "-e", "print qq(Hi, I'm $^X\n)"
827
8ebc5c01 828 int main(int argc, char **argv, char **env)
829 {
830 PerlInterpreter
831 *one_perl = perl_alloc(),
832 *two_perl = perl_alloc();
833 char *one_args[] = { "one_perl", SAY_HELLO };
834 char *two_args[] = { "two_perl", SAY_HELLO };
835
836 perl_construct(one_perl);
837 perl_construct(two_perl);
838
839 perl_parse(one_perl, NULL, 3, one_args, (char **)NULL);
840 perl_parse(two_perl, NULL, 3, two_args, (char **)NULL);
841
842 perl_run(one_perl);
843 perl_run(two_perl);
844
845 perl_destruct(one_perl);
846 perl_destruct(two_perl);
847
848 perl_free(one_perl);
849 perl_free(two_perl);
850 }
851
852
853Compile as usual:
854
855 % cc -o multiplicity multiplicity.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
856
857Run it, Run it:
858
859 % multiplicity
860 Hi, I'm one_perl
861 Hi, I'm two_perl
862
96dbc785 863=head2 Using Perl modules, which themselves use C libraries, from your C program
864
865If you've played with the examples above and tried to embed a script
866that I<use()>s a Perl module (such as I<Socket>) which itself uses a C or C++ library,
867this probably happened:
868
869
870 Can't load module Socket, dynamic loading not available in this perl.
871 (You may need to build a new perl executable which either supports
872 dynamic loading or has the Socket module statically linked into it.)
873
874
875What's wrong?
876
877Your interpreter doesn't know how to communicate with these extensions
878on its own. A little glue will help. Up until now you've been
879calling I<perl_parse()>, handing it NULL for the second argument:
880
881 perl_parse(my_perl, NULL, argc, my_argv, NULL);
882
883That's where the glue code can be inserted to create the initial contact between
884Perl and linked C/C++ routines. Let's take a look some pieces of I<perlmain.c>
885to see how Perl does this:
886
887
888 #ifdef __cplusplus
889 # define EXTERN_C extern "C"
890 #else
891 # define EXTERN_C extern
892 #endif
893
894 static void xs_init _((void));
895
896 EXTERN_C void boot_DynaLoader _((CV* cv));
897 EXTERN_C void boot_Socket _((CV* cv));
898
899
900 EXTERN_C void
901 xs_init()
902 {
903 char *file = __FILE__;
904 /* DynaLoader is a special case */
905 newXS("DynaLoader::boot_DynaLoader", boot_DynaLoader, file);
906 newXS("Socket::bootstrap", boot_Socket, file);
907 }
908
909Simply put: for each extension linked with your Perl executable
910(determined during its initial configuration on your
911computer or when adding a new extension),
912a Perl subroutine is created to incorporate the extension's
913routines. Normally, that subroutine is named
914I<Module::bootstrap()> and is invoked when you say I<use Module>. In
915turn, this hooks into an XSUB, I<boot_Module>, which creates a Perl
916counterpart for each of the extension's XSUBs. Don't worry about this
917part; leave that to the I<xsubpp> and extension authors. If your
918extension is dynamically loaded, DynaLoader creates I<Module::bootstrap()>
919for you on the fly. In fact, if you have a working DynaLoader then there
5f05dabc 920is rarely any need to link in any other extensions statically.
96dbc785 921
922
923Once you have this code, slap it into the second argument of I<perl_parse()>:
924
925
926 perl_parse(my_perl, xs_init, argc, my_argv, NULL);
927
928
929Then compile:
930
8a7dc658 931 % cc -o interp interp.c `perl -MExtUtils::Embed -e ccopts -e ldopts`
96dbc785 932
933 % interp
934 use Socket;
935 use SomeDynamicallyLoadedModule;
936
937 print "Now I can use extensions!\n"'
938
939B<ExtUtils::Embed> can also automate writing the I<xs_init> glue code.
940
8a7dc658 941 % perl -MExtUtils::Embed -e xsinit -- -o perlxsi.c
96dbc785 942 % cc -c perlxsi.c `perl -MExtUtils::Embed -e ccopts`
943 % cc -c interp.c `perl -MExtUtils::Embed -e ccopts`
8a7dc658 944 % cc -o interp perlxsi.o interp.o `perl -MExtUtils::Embed -e ldopts`
96dbc785 945
946Consult L<perlxs> and L<perlguts> for more details.
947
948
cb1a09d0
AD
949=head1 MORAL
950
951You can sometimes I<write faster code> in C, but
5f05dabc 952you can always I<write code faster> in Perl. Because you can use
cb1a09d0
AD
953each from the other, combine them as you wish.
954
955
956=head1 AUTHOR
957
8a7dc658
JO
958Jon Orwant and F<E<lt>orwant@media.mit.eduE<gt>> and Doug MacEachern
959F<E<lt>dougm@osf.orgE<gt>>, with small contributions from Tim Bunce,
960Tom Christiansen, Hallvard Furuseth, Dov Grobgeld, and Ilya Zakharevich.
961
962Check out Doug's article on embedding in Volume 1, Issue 4 of The Perl
963Journal. Info about TPJ is available from http://tpj.com.
cb1a09d0 964
8a7dc658 965February 1, 1997
cb1a09d0 966
8a7dc658
JO
967Some of this material is excerpted from Jon Orwant's book: I<Perl 5
968Interactive>, Waite Group Press, 1996 (ISBN 1-57169-064-6) and appears
cb1a09d0 969courtesy of Waite Group Press.
8a7dc658
JO
970
971=head1 COPYRIGHT
972
973Copyright (C) 1995, 1996, 1997 Doug MacEachern and Jon Orwant. All
974Rights Reserved.
975
976Although destined for release with the standard Perl distribution,
977this document is not public domain, nor is any of Perl and its
978documentation. Permission is granted to freely distribute verbatim
979copies of this document provided that no modifications outside of
980formatting be made, and that this notice remain intact. You are
981permitted and encouraged to use its code and derivatives thereof in
982your own source code for fun or for profit as you see fit.